Apr 16 02:31:06 devstack cinder-volume[73510]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 16 02:31:06 devstack cinder-volume[73510]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 02:31:06 devstack cinder-volume[73510]: we strongly recommend against using it for new projects.
Apr 16 02:31:06 devstack cinder-volume[73510]: If you are already using Eventlet, we recommend migrating to a different
Apr 16 02:31:06 devstack cinder-volume[73510]: framework.  For more detail see
Apr 16 02:31:06 devstack cinder-volume[73510]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 02:31:06 devstack cinder-volume[73510]:   import eventlet  # noqa
Apr 16 02:31:08 devstack cinder-volume[73510]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 02:31:08 devstack cinder-volume[73510]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 02:31:08 devstack cinder-volume[73510]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO dbcounter [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Registered counter for database cinder
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_db.sqlalchemy.engines [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG dbcounter [-] [73510] Writer thread running {{(pid=73510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO cinder.rpc [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO cinder.rpc [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_db.sqlalchemy.engines [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO cinder.volume.manager [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Determined volume DB was empty at startup.
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG cinder.volume.manager [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73510) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO cinder.volume.manager [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 16 02:31:09 devstack cinder-volume[73510]: WARNING stevedore.named [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 02:31:09 devstack cinder-volume[73510]: WARNING castellan.key_manager [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 02:31:09 devstack cinder-volume[73510]: WARNING cinder.keymgr.conf_key_mgr [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG cinder.volume.drivers.lvm [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73510) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_concurrency.processutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_concurrency.processutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.249s {{(pid=73510) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_db.sqlalchemy.engines [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO cinder.rpc [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO cinder.rpc [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 16 02:31:09 devstack cinder-volume[73510]: WARNING stevedore.named [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 02:31:09 devstack cinder-volume[73510]: WARNING castellan.key_manager [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO cinder.volume.manager [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_db.sqlalchemy.engines [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:31:09 devstack cinder-volume[73510]: INFO oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Starting 1 workers
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Started child 73612 {{(pid=73510) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Full set of CONF: {{(pid=73510) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] ******************************************************************************** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Configuration options gathered from: {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] ================================================================================ {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] allow_availability_zone_fallback = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] allow_compression_on_image_upload = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] allowed_direct_url_schemes     = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] api_rate_limit                 = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] auth_strategy                  = keystone {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73612]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] az_cache_duration              = 3600 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_availability_zone      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_host                   = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_name                   = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_stats_polling_interval = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backup_api_class               = cinder.backup.api.API {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backup_name_template           = backup-%s {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backup_use_same_host           = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backup_use_temp_snapshot       = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] chap_password                  = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] chap_username                  =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_internal_tenant_project_id = 913ebe15d2424286b9637ed6c0277f06 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_internal_tenant_user_id = e2e0bf7451594d71ae693392f56381a2 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cloned_volume_same_az          = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cluster                        = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] compression_format             = gzip {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] config_dir                     = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] config_source                  = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] control_exchange               = openstack {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] debug                          = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] default_availability_zone      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] default_group_type             = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] default_volume_type            = lvmdriver-1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] disk_geometry                  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] driver_client_cert             = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] driver_client_cert_key         = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] driver_data_namespace          = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] driver_ssl_cert_path           = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] driver_ssl_cert_verify         = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] driver_use_ssl                 = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] enable_force_upload            = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] enable_new_services            = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] enable_unsupported_driver      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] enforce_multipath_for_image_xfer = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] filter_function                = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_api_insecure            = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_api_servers             = ['http://192.168.122.14/image'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_api_ssl_compression     = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_ca_certificates_file    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_certfile                = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_keyfile                 = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_num_retries             = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance_request_timeout         = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] goodness_function              = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] graceful_shutdown_timeout      = 5 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] group_api_class                = cinder.group.api.API {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] host                           = devstack {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_compress_on_upload       = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_conversion_address_space_limit = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_conversion_cpu_limit     = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_conversion_disable       = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_upload_use_cinder_backend = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_upload_use_internal_tenant = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_volume_cache_enabled     = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_volume_cache_max_count   = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] image_volume_cache_max_size_gb = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] init_host_max_objects_retrieval = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] iscsi_target_flags             =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] iscsi_write_cache              = on {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] iser_helper                    = tgtadm {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] iser_ip_address                = 192.168.122.14 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] iser_port                      = 3260 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_color                      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_config_append              = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_dir                        = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_file                       = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_options                    = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_rotate_interval            = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_rotate_interval_type       = days {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] log_rotation_type              = none {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] max_age                        = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] max_logfile_count              = 30 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] max_logfile_size_mb            = 200 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] max_over_subscription_ratio    = 20.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] message_reap_interval          = 86400 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] message_ttl                    = 2592000 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] migration_create_volume_timeout_secs = 300 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] monkey_patch                   = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] monkey_patch_modules           = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] my_ip                          = 192.168.122.14 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] no_snapshot_gb_quota           = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] num_iser_scan_tries            = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] num_shell_tries                = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] num_volume_device_scan_tries   = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] nvmeof_conn_info_version       = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] nvmet_ns_id                    = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] nvmet_port_id                  = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] osapi_max_limit                = 1000 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] osapi_volume_ext_list          = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] osapi_volume_listen_port       = 8776 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] osapi_volume_use_ssl           = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] osapi_volume_workers           = 2 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] per_volume_size_limit          = -1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] periodic_fuzzy_delay           = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] periodic_interval              = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] public_endpoint                = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] publish_errors                 = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] quota_backup_gigabytes         = 1000 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] quota_backups                  = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] quota_gigabytes                = 1000 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] quota_groups                   = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] quota_snapshots                = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] quota_volumes                  = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] rate_limit_burst               = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] rate_limit_except_level        = CRITICAL {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] rate_limit_interval            = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] reinit_driver_count            = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] replication_device             = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] report_discard_supported       = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73612]: INFO cinder.volume.manager [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] report_interval                = 120 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] reservation_clean_interval     = 86400 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] reservation_expire             = 86400 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] reserved_image_namespaces      = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] reserved_percentage            = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] rpc_response_timeout           = 120 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] run_external_periodic_tasks    = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] scst_target_driver             = iscsi {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] scst_target_iqn_name           = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_down_time              = 720 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] shell_completion               = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] snapshot_name_template         = snapshot-%s {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] snapshot_same_host             = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] split_loggers                  = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] state_path                     = /opt/stack/data/cinder {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] storage_availability_zone      = nova {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] storage_protocol               = iSCSI {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] syslog_log_facility            = LOG_USER {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] target_helper                  = lioadm {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] target_ip_address              = 192.168.122.14 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] target_port                    = 3260 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] target_protocol                = iscsi {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] target_secondary_ip_addresses  = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] trace_flags                    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] transport_url                  = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] until_refresh                  = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] use_chap_auth                  = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] use_default_quota_class        = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] use_journal                    = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] use_json                       = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] use_multipath_for_image_xfer   = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] use_stderr                     = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] use_syslog                     = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] verify_glance_signatures       = enabled {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_api_class               = cinder.volume.api.API {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_backend_name            = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_clear                   = zero {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_clear_ionice            = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_clear_size              = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_copy_bps_limit          = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_dd_blocksize            = 1M {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_name_template           = volume-%s {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_service_inithost_offload = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volume_usage_audit_period      = month {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] zoning_mode                    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_concurrency.disable_process_locking = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.admin_password = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.admin_token = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.admin_user  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_protocol = https {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_section = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_type   = password {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_uri    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.auth_version = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.cache       = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.certfile    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.identity_uri = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.include_service_catalog = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.insecure    = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.interface   = public {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.keyfile     = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_password =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcache_username =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.region_name = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.service_type = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.backend                  = dogpile.cache.null {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.backend_argument         = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.backend_expiration_time  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.config_prefix            = cache.oslo {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.debug_cache_backend      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.enable_retry_client      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.enable_socket_keepalive  = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.enabled                  = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.enforce_fips_mode        = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.expiration_time          = 600 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.hashclient_retry_attempts = 2 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.memcache_dead_retry      = 300 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.memcache_sasl_enabled    = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.password                 = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.proxies                  = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.redis_db                 = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.redis_server             = localhost:6379 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.retry_attempts           = 2 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.retry_delay              = 0.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.socket_keepalive_count   = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.socket_keepalive_idle    = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.socket_keepalive_interval = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.socket_timeout           = 1.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.tls_allowed_ciphers      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.tls_cafile               = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.tls_certfile             = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.tls_enabled              = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.tls_keyfile              = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cache.username                 = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] coordination.backend_url       = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.asyncio_connection    = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.asyncio_slave_connection = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.backend               = sqlalchemy {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.connection            = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.connection_debug      = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.connection_parameters =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.connection_recycle_time = 3600 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.connection_trace      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.db_inc_retry_interval = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.db_max_retries        = 20 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.db_max_retry_interval = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.db_retry_interval     = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.max_overflow          = 50 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.max_pool_size         = 5 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.max_retries           = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.mysql_wsrep_sync_wait = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.pool_timeout          = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.retry_interval        = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.slave_connection      = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.sqlite_synchronous    = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.synchronous_reader    = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] database.use_db_reconnect      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.connection_string     = messaging:// {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.enabled               = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.es_doc_type           = notification {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.es_scroll_size        = 10000 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.es_scroll_time        = 2m {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.filter_error_trace    = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.hmac_keys             = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.sentinel_service_name = mymaster {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.socket_timeout        = 0.1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.trace_requests        = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler.trace_sqlalchemy      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler_jaeger.process_tags   = {} {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler_jaeger.service_name_prefix = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] profiler_otlp.service_name_prefix = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.enforce_new_defaults = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: WARNING oslo_config.cfg [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.enforce_scope      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.policy_default_rule = default {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] privsep_osbrick.group          = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] privsep_osbrick.helper_command = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] privsep_osbrick.user           = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_sys_admin.group         = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_sys_admin.helper_command = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] cinder_sys_admin.user          = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.auth_section      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.auth_type         = password {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.cafile            = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.certfile          = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.collect_timing    = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.insecure          = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.keyfile           = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.send_service_user_token = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.split_loggers     = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] service_user.timeout           = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.auth_section            = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.auth_type               = password {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.certfile                = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.collect_timing          = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.insecure                = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.keyfile                 = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.region_name             = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.split_loggers           = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] glance.timeout                 = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.backend_availability_zone = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.chap_password = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.chap_username =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.disk_geometry = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.driver_client_cert = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.driver_client_cert_key = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.driver_data_namespace = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.driver_use_ssl = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.extra_capabilities = {} {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.filter_function = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.goodness_function = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.iscsi_target_flags =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.iscsi_write_cache = on {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.iser_port     = 3260 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.lvm_share_target = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.lvm_type      = auto {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.num_shell_tries = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:09 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.replication_device = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.report_discard_supported = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.reserved_percentage = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.target_helper = tgtadm {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.target_port   = 3260 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.target_protocol = iscsi {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.trace_flags   = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.unique_fqdn_network = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.use_chap_auth = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_backend_name = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_clear  = zero {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_clear_ionice = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_clear_size = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_reports.file_event_handler = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_reports.log_dir           = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.backend_host       = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.chap_password      = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.chap_username      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.disk_geometry      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.driver_client_cert = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.extra_capabilities = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.filter_function    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.goodness_function  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.iser_helper        = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.iser_ip_address    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.iser_port          = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.lvm_share_target   = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.lvm_type           = auto {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.num_shell_tries    = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.replication_device = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.report_discard_supported = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.reserved_percentage = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.scst_target_driver = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.storage_protocol   = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.target_helper      = lioadm {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.target_ip_address  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.target_port        = 3260 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.trace_flags        = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.use_chap_auth      = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_clear       = zero {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_clear_size  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack sudo[73616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] lvmdriver-1.volumes_dir        = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack sudo[73616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_notifications.driver = [] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_notifications.retry = -1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] key_manager.fixed_key          = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.barbican_api_version  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.barbican_endpoint     = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.barbican_endpoint_type = public {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.barbican_region_name  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.cafile                = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.certfile              = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.collect_timing        = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.insecure              = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.keyfile               = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.number_of_retries     = 60 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.retry_delay           = 1 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.send_service_user_token = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.split_loggers         = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.timeout               = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.verify_ssl            = True {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican.verify_ssl_path       = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.auth_section = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.auth_type = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.cafile   = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.certfile = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.collect_timing = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.insecure = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.keyfile  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.split_loggers = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] barbican_service_user.timeout  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.approle_role_id          = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.approle_secret_id        = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.kv_mountpoint            = secret {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.kv_path                  = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.kv_version               = 2 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.namespace                = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.root_token_id            = **** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.ssl_ca_crt_file          = None {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.timeout                  = 60.0 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.use_ssl                  = False {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:31:09 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] ******************************************************************************** {{(pid=73510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 16 02:31:10 devstack sudo[73616]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:10 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:10 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:10 devstack sudo[73621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:10 devstack sudo[73621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:10 devstack sudo[73621]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:10 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.526s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:10 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:31:10 devstack cinder-volume[73612]: INFO cinder.brick.local_dev.lvm [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 16 02:31:10 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:10 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:10 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:10 devstack sudo[73794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:31:10 devstack sudo[73794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:11 devstack sudo[73794]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:11 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:11 devstack cinder-volume[73612]: DEBUG cinder.brick.local_dev.lvm [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73612) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 16 02:31:11 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:11 devstack sudo[74008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:11 devstack sudo[74008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:12 devstack sudo[74008]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.945s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:12 devstack sudo[74222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:12 devstack sudo[74222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:12 devstack sudo[74222]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:12 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:12 devstack sudo[74314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 16 02:31:12 devstack sudo[74314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:13 devstack sudo[74314]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:13 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.437s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:13 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:13 devstack sudo[74317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:31:13 devstack sudo[74317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:13 devstack sudo[74317]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:13 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:13 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:13 devstack sudo[74320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:31:13 devstack sudo[74320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:14 devstack sudo[74320]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:14 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:14 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:14 devstack sudo[74325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:31:14 devstack sudo[74325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:14 devstack sudo[74325]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:14 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:14 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:14 devstack sudo[74333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:14 devstack sudo[74333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:15 devstack sudo[74333]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:15 devstack sudo[74340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:15 devstack sudo[74340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:15 devstack sudo[74340]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:15 devstack cinder-volume[73612]: INFO cinder.volume.drivers.lvm [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:15 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:15 devstack sudo[74344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:15 devstack sudo[74344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:16 devstack sudo[74344]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:16 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:16 devstack cinder-volume[73612]: DEBUG cinder.volume.drivers.lvm [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Updating volume stats {{(pid=73612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 02:31:16 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:16 devstack sudo[74353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:31:16 devstack sudo[74353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:16 devstack sudo[74353]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:16 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:16 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:16 devstack sudo[74465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:31:16 devstack sudo[74465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:17 devstack sudo[74465]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:17 devstack sudo[74606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:17 devstack sudo[74606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:17 devstack sudo[74606]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:17 devstack sudo[74610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:31:17 devstack sudo[74610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:17 devstack sudo[74610]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:17 devstack cinder-volume[73612]: INFO cinder.volume.driver [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Driver hasn't implemented _init_vendor_properties()
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG cinder.volume.driver [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73612) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG oslo_db.sqlalchemy.engines [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG dbcounter [-] [73612] Writer thread running {{(pid=73612) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG cinder.db.sqlalchemy.api [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Building query based on filter {{(pid=73612) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG cinder.image.image_utils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73612) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 16 02:31:17 devstack cinder-volume[73612]: INFO cinder.keymgr.migration [None req-39432746-35f2-4505-8176-48a134dd9a8f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 16 02:31:17 devstack cinder-volume[73612]: DEBUG cinder.volume.drivers.lvm [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Updating volume stats {{(pid=73612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 02:31:18 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:18 devstack sudo[74615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:31:18 devstack sudo[74615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:18 devstack sudo[74615]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:18 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:18 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:18 devstack sudo[74618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:31:18 devstack sudo[74618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:18 devstack sudo[74618]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:18 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:18 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:18 devstack sudo[74624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:18 devstack sudo[74624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:19 devstack sudo[74624]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:19 devstack sudo[74628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:31:19 devstack sudo[74628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:19 devstack cinder-volume[73510]: DEBUG dbcounter [-] [73510] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:31:19 devstack sudo[74628]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG cinder.manager [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Notifying Schedulers of capabilities ... {{(pid=73612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:31:19 devstack cinder-volume[73612]: INFO cinder.volume.manager [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Driver initialization completed successfully.
Apr 16 02:31:19 devstack cinder-volume[73612]: INFO cinder.manager [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Initiating service 2 cleanup
Apr 16 02:31:19 devstack cinder-volume[73612]: INFO cinder.manager [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Service 2 cleanup completed.
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG cinder.service [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Creating RPC server for service cinder-volume {{(pid=73612) start /opt/stack/cinder/cinder/service.py:231}}
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG cinder.service [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73612) start /opt/stack/cinder/cinder/service.py:237}}
Apr 16 02:31:19 devstack cinder-volume[73612]: INFO cinder.volume.manager [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG cinder.volume.drivers.lvm [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Updating volume stats {{(pid=73612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 02:31:19 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:19 devstack sudo[74633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:31:19 devstack sudo[74633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:20 devstack sudo[74633]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:20 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:20 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:20 devstack sudo[74638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:31:20 devstack sudo[74638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:20 devstack sudo[74638]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:20 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:20 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:20 devstack sudo[74644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:31:20 devstack sudo[74644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:21 devstack sudo[74644]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:21 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:21 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:31:21 devstack sudo[74701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:31:21 devstack sudo[74701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:31:21 devstack sudo[74701]: pam_unix(sudo:session): session closed for user root
Apr 16 02:31:21 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:31:21 devstack cinder-volume[73612]: INFO cinder.volume.manager [None req-7370e770-a0a8-45f0-939e-36175e827125 None None] Driver post RPC initialization completed successfully.
Apr 16 02:31:29 devstack cinder-volume[73612]: DEBUG dbcounter [-] [73612] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73612) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:31:31 devstack cinder-volume[73612]: DEBUG dbcounter [-] [73612] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73612) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:32:40 devstack cinder-volume[73612]: DEBUG oslo_service.periodic_task [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73612) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:32:40 devstack cinder-volume[73612]: DEBUG cinder.volume.drivers.lvm [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Updating volume stats {{(pid=73612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 02:32:40 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:32:40 devstack sudo[79555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:32:40 devstack sudo[79555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:32:41 devstack sudo[79555]: pam_unix(sudo:session): session closed for user root
Apr 16 02:32:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:32:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:32:41 devstack sudo[79559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:32:41 devstack sudo[79559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:32:41 devstack sudo[79559]: pam_unix(sudo:session): session closed for user root
Apr 16 02:32:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:32:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:32:41 devstack sudo[79565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:32:41 devstack sudo[79565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:32:42 devstack sudo[79565]: pam_unix(sudo:session): session closed for user root
Apr 16 02:32:42 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:32:42 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:32:42 devstack sudo[79569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:32:42 devstack sudo[79569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:32:42 devstack sudo[79569]: pam_unix(sudo:session): session closed for user root
Apr 16 02:32:42 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:32:42 devstack cinder-volume[73612]: DEBUG cinder.manager [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Notifying Schedulers of capabilities ... {{(pid=73612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:33:31 devstack cinder-volume[73612]: DEBUG dbcounter [-] [73612] Writing DB stats cinder:SELECT=1 {{(pid=73612) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:33:31 devstack cinder-volume[73612]: DEBUG dbcounter [-] [73612] Writing DB stats cinder:UPDATE=1 {{(pid=73612) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:33:40 devstack cinder-volume[73612]: DEBUG oslo_service.periodic_task [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73612) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:33:40 devstack cinder-volume[73612]: DEBUG cinder.volume.drivers.lvm [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Updating volume stats {{(pid=73612) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 16 02:33:40 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:33:40 devstack sudo[81351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 16 02:33:40 devstack sudo[81351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:33:41 devstack sudo[81351]: pam_unix(sudo:session): session closed for user root
Apr 16 02:33:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:33:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:33:41 devstack sudo[81378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:33:41 devstack sudo[81378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:33:41 devstack sudo[81378]: pam_unix(sudo:session): session closed for user root
Apr 16 02:33:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:33:41 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:33:41 devstack sudo[81401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 16 02:33:41 devstack sudo[81401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:33:42 devstack sudo[81401]: pam_unix(sudo:session): session closed for user root
Apr 16 02:33:42 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:33:42 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:33:42 devstack sudo[81423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 16 02:33:42 devstack sudo[81423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:33:42 devstack sudo[81423]: pam_unix(sudo:session): session closed for user root
Apr 16 02:33:42 devstack cinder-volume[73612]: DEBUG oslo_concurrency.processutils [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=73612) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:33:42 devstack cinder-volume[73612]: DEBUG cinder.manager [None req-ffc154f3-94c3-48dd-ad0c-db89f64bd6af None None] Notifying Schedulers of capabilities ... {{(pid=73612) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:34:39 devstack cinder-volume[73510]: INFO oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Caught SIGTERM, stopping children
Apr 16 02:34:39 devstack cinder-volume[73510]: DEBUG oslo_concurrency.lockutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Acquiring lock "singleton_lock" {{(pid=73510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 02:34:39 devstack cinder-volume[73510]: DEBUG oslo_concurrency.lockutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Acquired lock "singleton_lock" {{(pid=73510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 02:34:39 devstack cinder-volume[73510]: DEBUG oslo_concurrency.lockutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Releasing lock "singleton_lock" {{(pid=73510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 02:34:39 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Stop services. {{(pid=73510) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 16 02:34:39 devstack cinder-volume[73510]: DEBUG oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Killing children. {{(pid=73510) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 16 02:34:39 devstack cinder-volume[73510]: INFO oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Waiting on 1 children to exit
Apr 16 02:34:39 devstack cinder-volume[73612]: DEBUG oslo_concurrency.lockutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Acquiring lock "singleton_lock" {{(pid=73612) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 02:34:39 devstack cinder-volume[73612]: DEBUG oslo_concurrency.lockutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Acquired lock "singleton_lock" {{(pid=73612) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 02:34:39 devstack cinder-volume[73612]: DEBUG oslo_concurrency.lockutils [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Releasing lock "singleton_lock" {{(pid=73612) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 02:34:39 devstack cinder-volume[73612]: WARNING amqp [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 02:34:39 devstack cinder-volume[73612]: WARNING amqp [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 02:34:39 devstack cinder-volume[73510]: INFO oslo_service.backend._eventlet.service [None req-2238a44e-5ced-49e1-9767-379b49c95ed7 None None] Child 73612 exited with status 0
Apr 16 02:34:40 devstack cinder-volume[82660]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 16 02:34:40 devstack cinder-volume[82660]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 02:34:40 devstack cinder-volume[82660]: we strongly recommend against using it for new projects.
Apr 16 02:34:40 devstack cinder-volume[82660]: If you are already using Eventlet, we recommend migrating to a different
Apr 16 02:34:40 devstack cinder-volume[82660]: framework.  For more detail see
Apr 16 02:34:40 devstack cinder-volume[82660]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 02:34:40 devstack cinder-volume[82660]:   import eventlet  # noqa
Apr 16 02:34:42 devstack cinder-volume[82660]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 02:34:42 devstack cinder-volume[82660]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 02:34:42 devstack cinder-volume[82660]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 02:34:42 devstack cinder-volume[82660]: INFO dbcounter [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Registered counter for database cinder
Apr 16 02:34:42 devstack cinder-volume[82660]: DEBUG oslo_db.sqlalchemy.engines [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:42 devstack cinder-volume[82660]: DEBUG dbcounter [-] [82660] Writer thread running {{(pid=82660) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 02:34:42 devstack cinder-volume[82660]: INFO cinder.rpc [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 16 02:34:42 devstack cinder-volume[82660]: INFO cinder.rpc [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 16 02:34:42 devstack cinder-volume[82660]: DEBUG oslo_db.sqlalchemy.engines [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:43 devstack cinder-volume[82660]: INFO cinder.volume.manager [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Determined volume DB was empty at startup.
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG cinder.volume.manager [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82660) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 16 02:34:43 devstack cinder-volume[82660]: INFO cinder.volume.manager [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 16 02:34:43 devstack cinder-volume[82660]: WARNING stevedore.named [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 02:34:43 devstack cinder-volume[82660]: WARNING castellan.key_manager [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 02:34:43 devstack cinder-volume[82660]: WARNING cinder.keymgr.conf_key_mgr [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 02:34:43 devstack cinder-volume[82660]: INFO cinder.volume.manager [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_db.sqlalchemy.engines [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:43 devstack cinder-volume[82660]: INFO oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Starting 1 workers
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Started child 82777 {{(pid=82660) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Full set of CONF: {{(pid=82660) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] ******************************************************************************** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Configuration options gathered from: {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] ================================================================================ {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 16 02:34:43 devstack cinder-volume[82777]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] allow_availability_zone_fallback = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] allow_compression_on_image_upload = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] allowed_direct_url_schemes     = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] api_rate_limit                 = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] auth_strategy                  = keystone {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_availability_zone      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_host                   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_name                   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_stats_polling_interval = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backup_api_class               = cinder.backup.api.API {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backup_name_template           = backup-%s {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backup_use_same_host           = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backup_use_temp_snapshot       = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] chap_password                  = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] chap_username                  =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_internal_tenant_project_id = 913ebe15d2424286b9637ed6c0277f06 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_internal_tenant_user_id = e2e0bf7451594d71ae693392f56381a2 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cluster                        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] compression_format             = gzip {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] compute_api_class              = cinder.compute.nova.API {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] config_dir                     = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] config_source                  = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] control_exchange               = openstack {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] debug                          = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] default_availability_zone      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] default_group_type             = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] default_volume_type            = QuobyteHD {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] disk_geometry                  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] driver_client_cert             = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] driver_client_cert_key         = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] driver_data_namespace          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] driver_ssl_cert_path           = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] driver_ssl_cert_verify         = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] driver_use_ssl                 = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] enable_new_services            = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] enable_unsupported_driver      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] enabled_backends               = ['QuobyteHD'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] enforce_multipath_for_image_xfer = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] filter_function                = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_api_insecure            = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_api_servers             = ['http://192.168.122.14/image'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_api_ssl_compression     = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_ca_certificates_file    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_catalog_info            = image:glance:publicURL {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_certfile                = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82777]: INFO cinder.volume.manager [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_keyfile                 = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.remotefs [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82777) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_num_retries             = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance_request_timeout         = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] goodness_function              = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] graceful_shutdown_timeout      = 5 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] group_api_class                = cinder.group.api.API {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] host                           = devstack {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_compress_on_upload       = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_conversion_address_space_limit = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_conversion_cpu_limit     = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_conversion_disable       = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_upload_use_cinder_backend = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_upload_use_internal_tenant = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_volume_cache_enabled     = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_volume_cache_max_count   = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] image_volume_cache_max_size_gb = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] init_host_max_objects_retrieval = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] instance_format                = [instance: %(uuid)s]  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] iscsi_target_flags             =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] iscsi_write_cache              = on {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] iser_helper                    = tgtadm {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] iser_ip_address                = 192.168.122.14 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] iser_port                      = 3260 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_color                      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_config_append              = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_dir                        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_file                       = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_options                    = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_rotate_interval            = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_rotate_interval_type       = days {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] log_rotation_type              = none {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] max_age                        = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] max_logfile_count              = 30 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] max_logfile_size_mb            = 200 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] max_over_subscription_ratio    = 20.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] message_reap_interval          = 86400 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] message_ttl                    = 2592000 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] migration_create_volume_timeout_secs = 300 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] monkey_patch                   = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] monkey_patch_modules           = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] my_ip                          = 192.168.122.14 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] no_snapshot_gb_quota           = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] num_iser_scan_tries            = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] num_shell_tries                = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] num_volume_device_scan_tries   = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] nvmeof_conn_info_version       = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] nvmet_ns_id                    = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] nvmet_port_id                  = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] osapi_max_limit                = 1000 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] osapi_volume_ext_list          = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] osapi_volume_listen_port       = 8776 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] osapi_volume_use_ssl           = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] osapi_volume_workers           = 2 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] per_volume_size_limit          = -1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] periodic_fuzzy_delay           = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] periodic_interval              = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] public_endpoint                = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] publish_errors                 = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] quota_backup_gigabytes         = 1000 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] quota_backups                  = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] quota_gigabytes                = 1000 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] quota_groups                   = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] quota_snapshots                = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] quota_volumes                  = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] rate_limit_burst               = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] rate_limit_except_level        = CRITICAL {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] rate_limit_interval            = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] reinit_driver_count            = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] replication_device             = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] report_discard_supported       = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] report_interval                = 120 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] reservation_clean_interval     = 86400 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] reservation_expire             = 86400 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] reserved_image_namespaces      = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] reserved_percentage            = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] rpc_response_timeout           = 120 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] run_external_periodic_tasks    = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] scst_target_driver             = iscsi {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] scst_target_iqn_name           = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_down_time              = 720 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] shell_completion               = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] snapshot_name_template         = snapshot-%s {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] split_loggers                  = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] state_path                     = /opt/stack/data/cinder {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] storage_availability_zone      = nova {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] storage_protocol               = iSCSI {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] syslog_log_facility            = LOG_USER {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] target_helper                  = lioadm {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] target_ip_address              = 192.168.122.14 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] target_port                    = 3260 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] target_protocol                = iscsi {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] target_secondary_ip_addresses  = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82777) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 16 02:34:43 devstack cinder-volume[82777]: WARNING cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 16 02:34:43 devstack cinder-volume[82777]: WARNING cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] trace_flags                    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] transport_url                  = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Running cmd (subprocess): mount.quobyte {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] until_refresh                  = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] use_chap_auth                  = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] use_default_quota_class        = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] use_journal                    = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] use_json                       = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] use_multipath_for_image_xfer   = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] use_stderr                     = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] use_syslog                     = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] verify_glance_signatures       = enabled {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_api_class               = cinder.volume.api.API {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_backend_name            = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_clear                   = zero {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_clear_ionice            = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_clear_size              = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_copy_bps_limit          = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_dd_blocksize            = 1M {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_name_template           = volume-%s {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_service_inithost_offload = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volume_usage_audit_period      = month {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] zoning_mode                    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_concurrency.disable_process_locking = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.admin_password = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.admin_token = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.admin_user  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_port   = 35357 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_protocol = https {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_section = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_type   = password {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_uri    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.auth_version = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.cache       = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.certfile    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.delay_auth_decision = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.http_connect_timeout = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.identity_uri = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.include_service_catalog = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.insecure    = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.interface   = public {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.keyfile     = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_password =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcache_username =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.region_name = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.service_token_roles_required = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.service_type = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.token_cache_time = 300 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.backend                  = dogpile.cache.null {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.backend_argument         = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.backend_expiration_time  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.config_prefix            = cache.oslo {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.debug_cache_backend      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.enable_retry_client      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.enable_socket_keepalive  = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.enabled                  = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.enforce_fips_mode        = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.expiration_time          = 600 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.hashclient_retry_attempts = 2 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.memcache_dead_retry      = 300 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.memcache_pool_maxsize    = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.memcache_sasl_enabled    = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.password                 = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.proxies                  = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.redis_db                 = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.redis_sentinel_service_name = mymaster {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.redis_server             = localhost:6379 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.retry_attempts           = 2 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.retry_delay              = 0.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.socket_keepalive_count   = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.socket_keepalive_idle    = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.socket_keepalive_interval = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.socket_timeout           = 1.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.tls_allowed_ciphers      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.tls_cafile               = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.tls_certfile             = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.tls_enabled              = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.tls_keyfile              = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cache.username                 = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] coordination.backend_url       = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.asyncio_connection    = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.asyncio_slave_connection = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.backend               = sqlalchemy {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.connection            = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.connection_debug      = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.connection_parameters =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.connection_recycle_time = 3600 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.connection_trace      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.db_inc_retry_interval = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.db_max_retries        = 20 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.db_max_retry_interval = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.db_retry_interval     = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.max_overflow          = 50 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.max_pool_size         = 5 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.max_retries           = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.mysql_wsrep_sync_wait = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.pool_timeout          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.retry_interval        = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.slave_connection      = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.sqlite_synchronous    = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.synchronous_reader    = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] database.use_db_reconnect      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.connection_string     = messaging:// {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.enabled               = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.es_doc_type           = notification {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.es_scroll_size        = 10000 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.es_scroll_time        = 2m {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.filter_error_trace    = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.hmac_keys             = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.sentinel_service_name = mymaster {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.socket_timeout        = 0.1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.trace_requests        = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler.trace_sqlalchemy      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler_jaeger.process_tags   = {} {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler_jaeger.service_name_prefix = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack quobyte-client[82778]: Reading configuration file: /etc/quobyte/client.cfg
Apr 16 02:34:43 devstack quobyte-client[82778]: Invalid parameters found, error: missing mount point.
Apr 16 02:34:43 devstack quobyte-client[82778]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 16 02:34:43 devstack quobyte-client[82778]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] profiler_otlp.service_name_prefix = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.enforce_new_defaults = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: WARNING oslo_config.cfg [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.enforce_scope      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.policy_default_rule = default {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.policy_file        = policy.yaml {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] privsep_osbrick.group          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] privsep_osbrick.helper_command = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] privsep_osbrick.user           = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_sys_admin.group         = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_sys_admin.helper_command = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] cinder_sys_admin.user          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.auth_section      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.auth_type         = password {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=82777) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.cafile            = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.certfile          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82777]: INFO cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 ...
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.collect_timing    = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 -c /etc/quobyte/client-cinder.cfg {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.insecure          = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.keyfile           = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.send_service_user_token = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.split_loggers     = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] service_user.timeout           = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.auth_section            = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.auth_type               = password {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.certfile                = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.collect_timing          = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.insecure                = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.keyfile                 = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.region_name             = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.split_loggers           = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] glance.timeout                 = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.backend_availability_zone = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.chap_password = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.chap_username =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.disk_geometry = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.driver_client_cert = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.driver_client_cert_key = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.driver_data_namespace = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.driver_use_ssl = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.enable_unsupported_driver = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.extra_capabilities = {} {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.filter_function = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.goodness_function = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.iscsi_target_flags =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.iscsi_write_cache = on {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.iser_helper   = tgtadm {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack sudo[82779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 -c /etc/quobyte/client-cinder.cfg
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.iser_port     = 3260 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack sudo[82779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_host      =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_login     = admin {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_mount_options = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_password  = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_private_key =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_share_path =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.num_shell_tries = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.nvmet_port_id = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.quobyte_client_cfg = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.quobyte_volume_url = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.replication_device = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.report_discard_supported = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.reserved_percentage = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.scst_target_driver = iscsi {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.scst_target_iqn_name = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.storage_protocol = iSCSI {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.target_helper = tgtadm {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.target_port   = 3260 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.target_protocol = iscsi {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.trace_flags   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.unique_fqdn_network = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.use_chap_auth = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_backend_name = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_clear  = zero {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_clear_ionice = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_clear_size = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_reports.file_event_handler = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_reports.log_dir           = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.backend_availability_zone = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.backend_host         = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.chap_password        = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.chap_username        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.chiscsi_conf         = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.disk_geometry        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.driver_client_cert   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.driver_client_cert_key = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.driver_data_namespace = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.driver_use_ssl       = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.extra_capabilities   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.filter_function      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.goodness_function    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.iser_helper          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.iser_ip_address      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.iser_port            = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.iser_target_prefix   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_host             = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_login            = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_mount_options    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_password         = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_private_key      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_share_path       = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_ssh_port         = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.num_shell_tries      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.nvmet_port_id        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.replication_device   = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.report_discard_supported = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.reserved_percentage  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.scst_target_driver   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.storage_protocol     = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.target_helper        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.target_ip_address    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.target_port          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.target_prefix        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.target_protocol      = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.trace_flags          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.use_chap_auth        = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_clear         = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_clear_size    = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] QuobyteHD.volumes_dir          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.ssl      = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_notifications.driver = [] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_notifications.retry = -1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] oslo_messaging_notifications.transport_url = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] key_manager.fixed_key          = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.barbican_api_version  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.barbican_endpoint     = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.barbican_endpoint_type = public {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.barbican_region_name  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.cafile                = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.certfile              = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.collect_timing        = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.insecure              = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.keyfile               = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.number_of_retries     = 60 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.retry_delay           = 1 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.send_service_user_token = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.split_loggers         = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.timeout               = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.verify_ssl            = True {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican.verify_ssl_path       = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.auth_section = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.auth_type = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.cafile   = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.certfile = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.collect_timing = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.insecure = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.keyfile  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.split_loggers = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] barbican_service_user.timeout  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.approle_role_id          = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.approle_secret_id        = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.kv_mountpoint            = secret {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.kv_path                  = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.kv_version               = 2 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.namespace                = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.root_token_id            = **** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.ssl_ca_crt_file          = None {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.timeout                  = 60.0 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.use_ssl                  = False {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:43 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] ******************************************************************************** {{(pid=82660) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 16 02:34:43 devstack sudo[82779]: pam_unix(sudo:session): session closed for user root
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.497s {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:43 devstack cinder-volume[82777]: INFO cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 succeeded
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=82777) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.504s {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:34:43 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:43 devstack sudo[82848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:34:43 devstack sudo[82848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:34:44 devstack sudo[82848]: pam_unix(sudo:session): session closed for user root
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.407s {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:44 devstack cinder-volume[82777]: INFO cinder.volume.driver [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Driver hasn't implemented _init_vendor_properties()
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.volume.driver [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82777) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_db.sqlalchemy.engines [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82777) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG dbcounter [-] [82777] Writer thread running {{(pid=82777) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.db.sqlalchemy.api [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Building query based on filter {{(pid=82777) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.image.image_utils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82777) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 16 02:34:44 devstack cinder-volume[82777]: INFO cinder.keymgr.migration [None req-63ca38f9-d0ae-459b-9af6-b41efb76147c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=82777) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=82777) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:44 devstack sudo[82851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:34:44 devstack sudo[82851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:34:44 devstack sudo[82851]: pam_unix(sudo:session): session closed for user root
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.400s {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.manager [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Notifying Schedulers of capabilities ... {{(pid=82777) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:34:44 devstack cinder-volume[82777]: INFO cinder.volume.manager [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Driver initialization completed successfully.
Apr 16 02:34:44 devstack cinder-volume[82777]: INFO cinder.manager [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Initiating service 3 cleanup
Apr 16 02:34:44 devstack cinder-volume[82777]: INFO cinder.manager [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Service 3 cleanup completed.
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.service [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Creating RPC server for service cinder-volume {{(pid=82777) start /opt/stack/cinder/cinder/service.py:231}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.service [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82777) start /opt/stack/cinder/cinder/service.py:237}}
Apr 16 02:34:44 devstack cinder-volume[82777]: INFO cinder.volume.manager [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=82777) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG cinder.volume.drivers.quobyte [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=82777) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82777) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:34:44 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:44 devstack sudo[82858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:34:44 devstack sudo[82858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:34:45 devstack sudo[82858]: pam_unix(sudo:session): session closed for user root
Apr 16 02:34:45 devstack cinder-volume[82777]: DEBUG oslo_concurrency.processutils [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.494s {{(pid=82777) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:45 devstack cinder-volume[82777]: INFO cinder.volume.manager [None req-346f2cd6-ca26-4e1a-ad51-90c5807d0f0f None None] Driver post RPC initialization completed successfully.
Apr 16 02:34:47 devstack cinder-volume[82660]: INFO oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Caught SIGTERM, stopping children
Apr 16 02:34:47 devstack cinder-volume[82660]: DEBUG oslo_concurrency.lockutils [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Acquiring lock "singleton_lock" {{(pid=82660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 02:34:47 devstack cinder-volume[82660]: DEBUG oslo_concurrency.lockutils [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Acquired lock "singleton_lock" {{(pid=82660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 02:34:47 devstack cinder-volume[82660]: DEBUG oslo_concurrency.lockutils [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Releasing lock "singleton_lock" {{(pid=82660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 02:34:47 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Stop services. {{(pid=82660) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 16 02:34:47 devstack cinder-volume[82660]: DEBUG oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Killing children. {{(pid=82660) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 16 02:34:47 devstack cinder-volume[82660]: INFO oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Waiting on 1 children to exit
Apr 16 02:34:48 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Acquiring lock "singleton_lock" {{(pid=82777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 02:34:48 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Acquired lock "singleton_lock" {{(pid=82777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 02:34:48 devstack cinder-volume[82777]: DEBUG oslo_concurrency.lockutils [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Releasing lock "singleton_lock" {{(pid=82777) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 02:34:48 devstack cinder-volume[82777]: WARNING amqp [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 02:34:48 devstack cinder-volume[82777]: WARNING amqp [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 16 02:34:48 devstack cinder-volume[82660]: INFO oslo_service.backend._eventlet.service [None req-0fa3a2f5-d49d-4993-8861-90b4b915138b None None] Child 82777 exited with status 0
Apr 16 02:34:49 devstack cinder-volume[82995]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 16 02:34:49 devstack cinder-volume[82995]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 02:34:49 devstack cinder-volume[82995]: we strongly recommend against using it for new projects.
Apr 16 02:34:49 devstack cinder-volume[82995]: If you are already using Eventlet, we recommend migrating to a different
Apr 16 02:34:49 devstack cinder-volume[82995]: framework.  For more detail see
Apr 16 02:34:49 devstack cinder-volume[82995]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 02:34:49 devstack cinder-volume[82995]:   import eventlet  # noqa
Apr 16 02:34:51 devstack cinder-volume[82995]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82995) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 16 02:34:51 devstack cinder-volume[82995]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82995) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 16 02:34:51 devstack cinder-volume[82995]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82995) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 16 02:34:51 devstack cinder-volume[82995]: INFO dbcounter [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Registered counter for database cinder
Apr 16 02:34:51 devstack cinder-volume[82995]: DEBUG oslo_db.sqlalchemy.engines [None req-5561a409-889e-4551-859c-68061084c0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82995) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:51 devstack cinder-volume[82995]: DEBUG dbcounter [-] [82995] Writer thread running {{(pid=82995) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 02:34:51 devstack cinder-volume[82995]: INFO cinder.rpc [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 16 02:34:51 devstack cinder-volume[82995]: INFO cinder.rpc [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 16 02:34:51 devstack cinder-volume[82995]: DEBUG oslo_db.sqlalchemy.engines [None req-5561a409-889e-4551-859c-68061084c0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82995) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:52 devstack cinder-volume[82995]: INFO cinder.volume.manager [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Determined volume DB was empty at startup.
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG cinder.volume.manager [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82995) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 16 02:34:52 devstack cinder-volume[82995]: WARNING stevedore.named [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 16 02:34:52 devstack cinder-volume[82995]: WARNING castellan.key_manager [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 02:34:52 devstack cinder-volume[82995]: WARNING cinder.keymgr.conf_key_mgr [None req-5561a409-889e-4551-859c-68061084c0d0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 16 02:34:52 devstack cinder-volume[82995]: INFO cinder.volume.manager [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_db.sqlalchemy.engines [None req-5561a409-889e-4551-859c-68061084c0d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82995) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:52 devstack cinder-volume[82995]: INFO oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Starting 1 workers
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Started child 83205 {{(pid=82995) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Full set of CONF: {{(pid=82995) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] ******************************************************************************** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Configuration options gathered from: {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 16 02:34:52 devstack cinder-volume[83205]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] ================================================================================ {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] allow_availability_zone_fallback = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] allow_compression_on_image_upload = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] allowed_direct_url_schemes     = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] api_rate_limit                 = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] auth_strategy                  = keystone {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_availability_zone      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_host                   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_name                   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_stats_polling_interval = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backup_api_class               = cinder.backup.api.API {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backup_name_template           = backup-%s {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backup_use_same_host           = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backup_use_temp_snapshot       = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] chap_password                  = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] chap_username                  =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_internal_tenant_project_id = 913ebe15d2424286b9637ed6c0277f06 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_internal_tenant_user_id = e2e0bf7451594d71ae693392f56381a2 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cluster                        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] compression_format             = gzip {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] config_dir                     = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] config_source                  = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] control_exchange               = openstack {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] debug                          = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] default_availability_zone      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] default_group_type             = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] default_volume_type            = QuobyteHD {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] disk_geometry                  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] driver_client_cert             = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] driver_client_cert_key         = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] driver_data_namespace          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] driver_ssl_cert_path           = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] driver_ssl_cert_verify         = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] driver_use_ssl                 = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] enable_new_services            = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] enable_unsupported_driver      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] enforce_multipath_for_image_xfer = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] filter_function                = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_api_insecure            = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_api_servers             = ['http://192.168.122.14/image'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_api_ssl_compression     = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_ca_certificates_file    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_certfile                = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_keyfile                 = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_num_retries             = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance_request_timeout         = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83205) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] goodness_function              = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] graceful_shutdown_timeout      = 5 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] group_api_class                = cinder.group.api.API {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] host                           = devstack {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_compress_on_upload       = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_conversion_address_space_limit = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_conversion_cpu_limit     = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_conversion_disable       = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_upload_use_cinder_backend = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_upload_use_internal_tenant = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_volume_cache_enabled     = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_volume_cache_max_count   = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] image_volume_cache_max_size_gb = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] init_host_max_objects_retrieval = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] iscsi_target_flags             =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] iscsi_write_cache              = on {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] iser_helper                    = tgtadm {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] iser_ip_address                = 192.168.122.14 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] iser_port                      = 3260 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_color                      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_config_append              = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_dir                        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_file                       = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_options                    = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_rotate_interval            = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_rotate_interval_type       = days {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] log_rotation_type              = none {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] max_age                        = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] max_logfile_count              = 30 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] max_logfile_size_mb            = 200 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] max_over_subscription_ratio    = 20.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] message_reap_interval          = 86400 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] message_ttl                    = 2592000 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] migration_create_volume_timeout_secs = 300 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] monkey_patch                   = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] monkey_patch_modules           = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] my_ip                          = 192.168.122.14 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] no_snapshot_gb_quota           = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] num_iser_scan_tries            = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] num_shell_tries                = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] num_volume_device_scan_tries   = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] nvmeof_conn_info_version       = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] nvmet_ns_id                    = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] nvmet_port_id                  = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] osapi_max_limit                = 1000 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] osapi_volume_ext_list          = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] osapi_volume_listen_port       = 8776 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] osapi_volume_use_ssl           = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] osapi_volume_workers           = 2 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] per_volume_size_limit          = -1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] periodic_fuzzy_delay           = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] periodic_interval              = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] public_endpoint                = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] publish_errors                 = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] quota_backup_gigabytes         = 1000 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] quota_backups                  = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] quota_gigabytes                = 1000 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] quota_groups                   = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] quota_snapshots                = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] quota_volumes                  = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] rate_limit_burst               = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] rate_limit_except_level        = CRITICAL {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] rate_limit_interval            = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] reinit_driver_count            = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] replication_device             = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] report_discard_supported       = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] report_interval                = 120 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] reservation_clean_interval     = 86400 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] reservation_expire             = 86400 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] reserved_image_namespaces      = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] reserved_percentage            = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] rpc_response_timeout           = 120 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] run_external_periodic_tasks    = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] scst_target_driver             = iscsi {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] scst_target_iqn_name           = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_down_time              = 720 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] shell_completion               = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] snapshot_name_template         = snapshot-%s {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] split_loggers                  = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] state_path                     = /opt/stack/data/cinder {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] storage_availability_zone      = nova {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] storage_protocol               = iSCSI {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] syslog_log_facility            = LOG_USER {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] target_helper                  = lioadm {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] target_ip_address              = 192.168.122.14 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] target_port                    = 3260 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] target_protocol                = iscsi {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] target_secondary_ip_addresses  = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] trace_flags                    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] transport_url                  = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] until_refresh                  = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] use_chap_auth                  = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] use_default_quota_class        = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] use_journal                    = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] use_json                       = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] use_multipath_for_image_xfer   = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] use_stderr                     = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] use_syslog                     = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] verify_glance_signatures       = enabled {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_api_class               = cinder.volume.api.API {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_backend_name            = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_clear                   = zero {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_clear_ionice            = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_clear_size              = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_copy_bps_limit          = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_dd_blocksize            = 1M {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_name_template           = volume-%s {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_service_inithost_offload = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volume_usage_audit_period      = month {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] zoning_mode                    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_concurrency.disable_process_locking = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.admin_password = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.admin_token = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.admin_user  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_protocol = https {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_section = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_type   = password {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_uri    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.auth_version = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.cache       = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.certfile    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.identity_uri = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.include_service_catalog = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.insecure    = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.interface   = public {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.keyfile     = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_password =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcache_username =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.region_name = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.service_type = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.backend                  = dogpile.cache.null {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.backend_argument         = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.backend_expiration_time  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83205) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 16 02:34:52 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.config_prefix            = cache.oslo {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.debug_cache_backend      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.enable_retry_client      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.enable_socket_keepalive  = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.enabled                  = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Running cmd (subprocess): mount.quobyte {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.enforce_fips_mode        = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.expiration_time          = 600 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.hashclient_retry_attempts = 2 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.memcache_dead_retry      = 300 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.memcache_sasl_enabled    = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.password                 = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.proxies                  = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.redis_db                 = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.redis_server             = localhost:6379 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.retry_attempts           = 2 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.retry_delay              = 0.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.socket_keepalive_count   = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.socket_keepalive_idle    = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.socket_keepalive_interval = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.socket_timeout           = 1.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.tls_allowed_ciphers      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.tls_cafile               = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.tls_certfile             = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.tls_enabled              = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.tls_keyfile              = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cache.username                 = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] coordination.backend_url       = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.asyncio_connection    = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.asyncio_slave_connection = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.backend               = sqlalchemy {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.connection            = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.connection_debug      = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.connection_parameters =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.connection_recycle_time = 3600 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.connection_trace      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.db_inc_retry_interval = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.db_max_retries        = 20 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.db_max_retry_interval = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.db_retry_interval     = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.max_overflow          = 50 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.max_pool_size         = 5 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.max_retries           = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.mysql_wsrep_sync_wait = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.pool_timeout          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.retry_interval        = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.slave_connection      = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.sqlite_synchronous    = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.synchronous_reader    = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] database.use_db_reconnect      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.connection_string     = messaging:// {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.enabled               = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.es_doc_type           = notification {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.es_scroll_size        = 10000 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.es_scroll_time        = 2m {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.filter_error_trace    = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.hmac_keys             = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.sentinel_service_name = mymaster {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.socket_timeout        = 0.1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.trace_requests        = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler.trace_sqlalchemy      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler_jaeger.process_tags   = {} {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler_jaeger.service_name_prefix = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] profiler_otlp.service_name_prefix = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.enforce_new_defaults = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: WARNING oslo_config.cfg [None req-5561a409-889e-4551-859c-68061084c0d0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.enforce_scope      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.policy_default_rule = default {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] privsep_osbrick.group          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] privsep_osbrick.helper_command = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] privsep_osbrick.user           = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_sys_admin.group         = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_sys_admin.helper_command = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] cinder_sys_admin.user          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.auth_section      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.auth_type         = password {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.cafile            = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.certfile          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.collect_timing    = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.insecure          = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.keyfile           = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.send_service_user_token = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.split_loggers     = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] service_user.timeout           = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.auth_section            = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.auth_type               = password {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.certfile                = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.collect_timing          = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.insecure                = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.keyfile                 = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.region_name             = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.split_loggers           = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] glance.timeout                 = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.backend_availability_zone = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.chap_password = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.chap_username =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.disk_geometry = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.driver_client_cert = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.driver_client_cert_key = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.driver_data_namespace = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.driver_use_ssl = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack quobyte-client[83209]: Reading configuration file: /etc/quobyte/client.cfg
Apr 16 02:34:52 devstack quobyte-client[83209]: Invalid parameters found, error: missing mount point.
Apr 16 02:34:52 devstack quobyte-client[83209]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 16 02:34:52 devstack quobyte-client[83209]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.extra_capabilities = {} {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.filter_function = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.goodness_function = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.iscsi_target_flags =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.iscsi_write_cache = on {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.iser_port     = 3260 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_host      =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_login     = admin {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_mount_options = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_password  = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_private_key =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_share_path =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.num_shell_tries = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.quobyte_volume_url = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.replication_device = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.report_discard_supported = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.reserved_percentage = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.target_helper = tgtadm {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.target_port   = 3260 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.target_protocol = iscsi {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.trace_flags   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.unique_fqdn_network = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.use_chap_auth = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_backend_name = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_clear  = zero {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_clear_ionice = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_clear_size = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_reports.file_event_handler = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_reports.log_dir           = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.backend_availability_zone = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.backend_host         = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.chap_password        = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.chap_username        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.disk_geometry        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.driver_client_cert   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.driver_data_namespace = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack sudo[83220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack sudo[83220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.extra_capabilities   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.filter_function      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.goodness_function    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.iser_helper          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.iser_ip_address      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.iser_port            = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_host             = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_login            = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_mount_options    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_password         = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_private_key      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_share_path       = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.num_shell_tries      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.replication_device   = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.report_discard_supported = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.reserved_percentage  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.scst_target_driver   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.storage_protocol     = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.target_helper        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.target_ip_address    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.target_port          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.target_prefix        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.target_protocol      = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.trace_flags          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.use_chap_auth        = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_clear         = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_clear_size    = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] QuobyteHD.volumes_dir          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_notifications.driver = [] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_notifications.retry = -1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] key_manager.fixed_key          = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.barbican_api_version  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.barbican_endpoint     = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.barbican_endpoint_type = public {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.barbican_region_name  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.cafile                = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.certfile              = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.collect_timing        = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.insecure              = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.keyfile               = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.number_of_retries     = 60 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.retry_delay           = 1 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.send_service_user_token = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.split_loggers         = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.timeout               = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.verify_ssl            = True {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican.verify_ssl_path       = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.auth_section = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.auth_type = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.cafile   = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.certfile = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.collect_timing = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.insecure = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.keyfile  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.split_loggers = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] barbican_service_user.timeout  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.approle_role_id          = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.approle_secret_id        = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.kv_mountpoint            = secret {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.kv_path                  = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.kv_version               = 2 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.namespace                = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.root_token_id            = **** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.ssl_ca_crt_file          = None {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.timeout                  = 60.0 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.use_ssl                  = False {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 16 02:34:52 devstack cinder-volume[82995]: DEBUG oslo_service.backend._eventlet.service [None req-5561a409-889e-4551-859c-68061084c0d0 None None] ******************************************************************************** {{(pid=82995) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 16 02:34:52 devstack sudo[83220]: pam_unix(sudo:session): session closed for user root
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.421s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:52 devstack cinder-volume[83205]: INFO cinder.volume.driver [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Driver hasn't implemented _init_vendor_properties()
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.volume.driver [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83205) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_db.sqlalchemy.engines [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writer thread running {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.db.sqlalchemy.api [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Building query based on filter {{(pid=83205) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83205) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:34:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:52 devstack cinder-volume[83205]: INFO cinder.keymgr.migration [None req-0ed0c24a-8b7f-4abb-9f17-ca795f4e70c4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 16 02:34:52 devstack sudo[83240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:34:52 devstack sudo[83240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.579s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:34:53 devstack sudo[83240]: pam_unix(sudo:session): session closed for user root
Apr 16 02:34:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Driver initialization completed successfully.
Apr 16 02:34:53 devstack cinder-volume[83205]: INFO cinder.manager [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Initiating service 3 cleanup
Apr 16 02:34:53 devstack cinder-volume[83205]: INFO cinder.manager [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Service 3 cleanup completed.
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG cinder.service [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Creating RPC server for service cinder-volume {{(pid=83205) start /opt/stack/cinder/cinder/service.py:231}}
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG cinder.service [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83205) start /opt/stack/cinder/cinder/service.py:237}}
Apr 16 02:34:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:34:53 devstack sudo[83249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:34:53 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:34:53 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root
Apr 16 02:34:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.385s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:34:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a74a4b1e-7896-4115-a4e2-d53e62da4cf5 None None] Driver post RPC initialization completed successfully.
Apr 16 02:35:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a2e3ed1e-3689-42e8-85b1-3600815793e4 tempest-BackendsCapabilitiesAdminTestsJSON-562403318 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83205) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 16 02:35:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-73bdae62-3411-42da-bb98-7a89c069e941 tempest-BackendsCapabilitiesAdminTestsJSON-562403318 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732810974121, 'free_capacity_gb': 1775.732810974121, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83205) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 16 02:35:02 devstack cinder-volume[82995]: DEBUG dbcounter [-] [82995] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82995) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:35:03 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:35:03 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=3 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Flow 'volume_create_manager' (3e051678-4bb0-4282-a66a-5f9a5c63cdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65319a27-f6d2-4f50-9d09-438e4601deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65319a27-f6d2-4f50-9d09-438e4601deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1111520157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45528be4-4541-43ab-af2f-6658808efe0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66371da12a0c4183b9dcf6547cc3a8fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:35:52Z,use_quota=True,user_id='9e418220d60a4b819914503021c779e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f448ec-2d81-47b0-8ca2-1758470d3a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f448ec-2d81-47b0-8ca2-1758470d3a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35fa0699-e61e-4360-a06a-854b4325215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35fa0699-e61e-4360-a06a-854b4325215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45528be4-4541-43ab-af2f-6658808efe0f', 'volume_name': 'volume-45528be4-4541-43ab-af2f-6658808efe0f', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33176e02-c461-45be-9d02-c08ab61fbf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33176e02-c461-45be-9d02-c08ab61fbf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73549bc0-3148-4ed6-b3e0-164e62e444a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Volume 45528be4-4541-43ab-af2f-6658808efe0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45528be4-4541-43ab-af2f-6658808efe0f', 'volume_size': 1}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1111520157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45528be4-4541-43ab-af2f-6658808efe0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66371da12a0c4183b9dcf6547cc3a8fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:35:52Z,use_quota=True,user_id='9e418220d60a4b819914503021c779e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Creating volume 45528be4-4541-43ab-af2f-6658808efe0f {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:35:52 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:52 devstack sudo[83751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f 1073741824
Apr 16 02:35:52 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b2bb73f6-51bc-4580-9cd6-07c1782ddd42 tempest-GroupSnapshotsTest-1816305183 None] Group tempest-GroupSnapshotsTest-Group-1883565900: creating
Apr 16 02:35:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b2bb73f6-51bc-4580-9cd6-07c1782ddd42 tempest-GroupSnapshotsTest-1816305183 None] Group tempest-GroupSnapshotsTest-Group-1883565900: created successfully
Apr 16 02:35:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b2bb73f6-51bc-4580-9cd6-07c1782ddd42 tempest-GroupSnapshotsTest-1816305183 None] Create group completed successfully.
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Flow 'volume_create_manager' (041491cf-897f-4153-85d3-31f6ae75e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a4247c-a654-44f6-8dfb-614652edc063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a4247c-a654-44f6-8dfb-614652edc063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-525898576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de592c33-df20-427b-9eb0-aba2790f56d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bf0cd9a42a4d3bba18256a17e8ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:35:52Z,use_quota=True,user_id='558cdede57ec40d9adf0a7f0d36d819f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036ee7cb-c52c-4247-a176-00f800701bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036ee7cb-c52c-4247-a176-00f800701bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7f02e0-7bf5-4fdd-8d2e-fc518eba1e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7f02e0-7bf5-4fdd-8d2e-fc518eba1e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de592c33-df20-427b-9eb0-aba2790f56d0', 'volume_name': 'volume-de592c33-df20-427b-9eb0-aba2790f56d0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77896638-c52f-4212-a222-d5515a4c0add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77896638-c52f-4212-a222-d5515a4c0add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d164305b-cbed-406a-a637-9e9b7bce2ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:52 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Volume de592c33-df20-427b-9eb0-aba2790f56d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de592c33-df20-427b-9eb0-aba2790f56d0', 'volume_size': 1}
Apr 16 02:35:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:53 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f 1073741824" returned: 0 in 1.345s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:53 devstack sudo[84088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f
Apr 16 02:35:53 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (977dd8d6-05d8-4b20-98a6-37b4a25647ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80741567-d554-4dc9-8efa-061f48d0bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80741567-d554-4dc9-8efa-061f48d0bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288643178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=159bcdda-a808-43c1-9c41-64f031412858,host='devstack@QuobyteHD#QuobyteHD',id=14612747-10ac-4fee-93a4-824fb257d2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:35:54Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c0c79c-aa30-4867-9468-a2b54eeee278),volume_type_id=b1c0c79c-aa30-4867-9468-a2b54eeee278)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551d0fd9-2f16-442e-843d-bb3c91e73233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551d0fd9-2f16-442e-843d-bb3c91e73233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2c9bc-a5b4-41ee-a9cc-6d3ba2cccf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d2c9bc-a5b4-41ee-a9cc-6d3ba2cccf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14612747-10ac-4fee-93a4-824fb257d2b4', 'volume_name': 'volume-14612747-10ac-4fee-93a4-824fb257d2b4', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78839a06-ac9c-4c99-a2e0-4e6cf5cb2800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78839a06-ac9c-4c99-a2e0-4e6cf5cb2800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482e6564-10cf-45d5-b006-eac771f9e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:54 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Volume 14612747-10ac-4fee-93a4-824fb257d2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14612747-10ac-4fee-93a4-824fb257d2b4', 'volume_size': 1}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:54 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f" returned: 0 in 0.926s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.365s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.142s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-525898576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de592c33-df20-427b-9eb0-aba2790f56d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bf0cd9a42a4d3bba18256a17e8ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:35:52Z,use_quota=True,user_id='558cdede57ec40d9adf0a7f0d36d819f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Creating volume de592c33-df20-427b-9eb0-aba2790f56d0 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:35:54 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73549bc0-3148-4ed6-b3e0-164e62e444a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45528be4-4541-43ab-af2f-6658808efe0f', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b2c0b2-a44a-44be-bf1c-452029e62c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:54 devstack sudo[84095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0 1073741824
Apr 16 02:35:54 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:54 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Volume volume-45528be4-4541-43ab-af2f-6658808efe0f (45528be4-4541-43ab-af2f-6658808efe0f): created successfully
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b2c0b2-a44a-44be-bf1c-452029e62c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Flow 'volume_create_manager' (3e051678-4bb0-4282-a66a-5f9a5c63cdc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:35:54 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-6053479f-5af9-4903-8203-3d8279fbecbf req-ebfb403a-7f1d-47b8-a8b5-b1d9a5ac8cb0 tempest-VolumesGetTestJSON-1411461653 None] Created volume successfully.
Apr 16 02:35:55 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0 1073741824" returned: 0 in 1.051s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:55 devstack sudo[84100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0
Apr 16 02:35:55 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Acquiring lock "cinder-45528be4-4541-43ab-af2f-6658808efe0f-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Lock "cinder-45528be4-4541-43ab-af2f-6658808efe0f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Acquiring lock "cinder-quobyte-45528be4-4541-43ab-af2f-6658808efe0f" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Lock "cinder-quobyte-45528be4-4541-43ab-af2f-6658808efe0f" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:35:56 devstack cinder-volume[83205]: INFO oslo.privsep.daemon [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_hnef871/privsep.sock']
Apr 16 02:35:56 devstack sudo[84105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_hnef871/privsep.sock
Apr 16 02:35:56 devstack sudo[84105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:56 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0" returned: 0 in 0.937s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.378s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=159bcdda-a808-43c1-9c41-64f031412858,created_at=2026-04-16T00:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288643178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=159bcdda-a808-43c1-9c41-64f031412858,host='devstack@QuobyteHD#QuobyteHD',id=14612747-10ac-4fee-93a4-824fb257d2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:35:54Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c0c79c-aa30-4867-9468-a2b54eeee278),volume_type_id=b1c0c79c-aa30-4867-9468-a2b54eeee278)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Creating volume 14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:35:56 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d164305b-cbed-406a-a637-9e9b7bce2ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de592c33-df20-427b-9eb0-aba2790f56d0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1e21be-1bf7-4852-80be-d501621bf9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:56 devstack sudo[84107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 1073741824
Apr 16 02:35:56 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:56 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Volume volume-de592c33-df20-427b-9eb0-aba2790f56d0 (de592c33-df20-427b-9eb0-aba2790f56d0): created successfully
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1e21be-1bf7-4852-80be-d501621bf9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Flow 'volume_create_manager' (041491cf-897f-4153-85d3-31f6ae75e524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:35:56 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c725ec64-35a5-4d9d-8a81-b50c32ce64b8 tempest-ServerRescueNegativeTestJSON-1075683699 None] Created volume successfully.
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 16 02:35:57 devstack cinder-volume[83205]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 16 02:35:57 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 1073741824" returned: 0 in 0.697s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:57 devstack sudo[84113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4
Apr 16 02:35:57 devstack sudo[84113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:58 devstack sudo[84105]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO oslo.privsep.daemon [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Spawned new privsep daemon via rootwrap
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Accepted privsep connection to /tmp/tmp_hnef871/privsep.sock {{(pid=83205) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84115
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[750fbe5c-e417-47a2-b9c2-d7b4fefbd441]: (2,) {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf5f244-72a6-4c92-ae59-4e1ead387da1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:58 devstack sudo[84118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f
Apr 16 02:35:58 devstack sudo[84118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:58 devstack sudo[84113]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4" returned: 0 in 0.865s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482e6564-10cf-45d5-b006-eac771f9e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14612747-10ac-4fee-93a4-824fb257d2b4', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf61a29-8dd1-47b3-8ee0-085d99749901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Volume volume-14612747-10ac-4fee-93a4-824fb257d2b4 (14612747-10ac-4fee-93a4-824fb257d2b4): created successfully
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf61a29-8dd1-47b3-8ee0-085d99749901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (977dd8d6-05d8-4b20-98a6-37b4a25647ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-91e39bca-83f2-4f6c-b2da-711a5233d674 tempest-GroupSnapshotsTest-1816305183 None] Created volume successfully.
Apr 16 02:35:58 devstack sudo[84118]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f" returned: 0 in 0.611s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:58 devstack sudo[84124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f
Apr 16 02:35:58 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] GroupSnapshot ef6df0e0-5a5d-4ce5-8619-a8d5b92dbf99: creating.
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Group snapshot ef6df0e0-5a5d-4ce5-8619-a8d5b92dbf99: creating. {{(pid=83205) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Creating offline snapshot ecdb4390-98d3-4974-8e0a-e6afbba18ad0 of volume 14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e462ee-57b6-47d4-9911-753a9f38cc5b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:59 devstack sudo[84126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4
Apr 16 02:35:59 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:59 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-45528be4-4541-43ab-af2f-6658808efe0f" returned: 0 in 0.928s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Lock "cinder-quobyte-45528be4-4541-43ab-af2f-6658808efe0f" released by "delete_volume" :: held 2.975s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:35:59 devstack cinder-volume[83205]: WARNING cinder.quota [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:35:59 devstack cinder-volume[83205]: WARNING cinder.quota [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.quota [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Created reservations ['3d9549c4-4fa8-4364-8eb2-6b8f3953b8d1', 'c568de4a-4b93-4c05-941b-b6f6b62b8d31', 'ba7d0176-566e-440b-9ea2-2901ffc93b5c', '7db2637a-fc00-42f7-8a82-88fa7093f947'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:59 devstack sudo[84165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:35:59 devstack sudo[84165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:35:59 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4" returned: 0 in 0.860s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:35:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:35:59 devstack sudo[84169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 1G
Apr 16 02:35:59 devstack sudo[84169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:00 devstack sudo[84171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:00 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:00 devstack sudo[84165]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.829s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:00 devstack cinder-volume[83205]: DEBUG cinder.manager [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Deleted volume successfully.
Apr 16 02:36:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-8f9ad1e9-ed26-498c-a4ff-c01c2276e3a9 req-2b58cdff-35a8-49be-b42c-20c484c822e8 tempest-VolumesGetTestJSON-1411461653 None] Lock "cinder-45528be4-4541-43ab-af2f-6658808efe0f-delete_volume" released by "delete_volume" :: held 4.102s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:00 devstack sudo[84169]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 1G" returned: 0 in 0.866s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14612747-10ac-4fee-93a4-824fb257d2b4 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:00 devstack sudo[84177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14612747-10ac-4fee-93a4-824fb257d2b4 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0
Apr 16 02:36:00 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:00 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.967s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:01 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14612747-10ac-4fee-93a4-824fb257d2b4 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0" returned: 0 in 0.616s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:01 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:01 devstack sudo[84184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0
Apr 16 02:36:01 devstack sudo[84184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:02 devstack sudo[84184]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0" returned: 0 in 0.771s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:02 devstack sudo[84217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.info
Apr 16 02:36:02 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:03 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.info" returned: 0 in 0.797s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:03 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:03 devstack sudo[84228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.info
Apr 16 02:36:03 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:03 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.info" returned: 0 in 0.840s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.852s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8dd37253-ee2d-4368-9787-936a942fab36 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot ef6df0e0-5a5d-4ce5-8619-a8d5b92dbf99: created successfully
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-ecdb4390-98d3-4974-8e0a-e6afbba18ad0-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-ecdb4390-98d3-4974-8e0a-e6afbba18ad0-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Creating volume cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 from snapshot ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] snapshot: ecdb4390-98d3-4974-8e0a-e6afbba18ad0, volume: cd81f1f9-b13f-4ef2-91b9-d35dc62e5524,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc84cd-82bd-4ef8-803c-5efe4c9ceb9a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:05 devstack sudo[84243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0
Apr 16 02:36:05 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:06 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0" returned: 0 in 0.827s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14612747-10ac-4fee-93a4-824fb257d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:36:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:36:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:36:06 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecbe605-77c4-4e13-89f9-a79a6a174b44]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:06 devstack sudo[84262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4
Apr 16 02:36:06 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:08 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4" returned: 0 in 1.530s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:08 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:36:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:08 devstack sudo[84307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524
Apr 16 02:36:08 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:12 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2c007a07-07bc-429a-98b7-83eeb5028792 tempest-GroupSnapshotsV319Test-2003686330 None] Group tempest-GroupSnapshotsV319Test-Group-322558170: creating
Apr 16 02:36:12 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2c007a07-07bc-429a-98b7-83eeb5028792 tempest-GroupSnapshotsV319Test-2003686330 None] Group tempest-GroupSnapshotsV319Test-Group-322558170: created successfully
Apr 16 02:36:12 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2c007a07-07bc-429a-98b7-83eeb5028792 tempest-GroupSnapshotsV319Test-2003686330 None] Create group completed successfully.
Apr 16 02:36:13 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" returned: 0 in 5.232s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:13 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a742e-a637-480e-8a96-e98b56a52833]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:13 devstack sudo[84338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4
Apr 16 02:36:13 devstack sudo[84338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Flow 'volume_create_manager' (37b3ba68-560f-4df9-9cd3-91cbfb2b9352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370efb96-bf9a-4990-904e-a75be439d8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370efb96-bf9a-4990-904e-a75be439d8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-449492245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5e3669fc-a7da-4276-b83e-1c208ae6a3f9,host='devstack@QuobyteHD#QuobyteHD',id=c3975b24-3dd8-4922-8dcf-66ab8484bbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8747143d2194d3aacf3afbfd8ed2a82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:14Z,use_quota=True,user_id='69001f86169a497081a676d4d41e5531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(596b50f0-ed9c-42d5-87e2-2b1b88fbd723),volume_type_id=596b50f0-ed9c-42d5-87e2-2b1b88fbd723)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dab1c7-3f51-46d4-bd93-ad66a53f73d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dab1c7-3f51-46d4-bd93-ad66a53f73d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758beaf7-e596-42a8-b26f-e48c453e99ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758beaf7-e596-42a8-b26f-e48c453e99ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3975b24-3dd8-4922-8dcf-66ab8484bbff', 'volume_name': 'volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7ca1fd-7099-4da2-a1c6-7788bf1a9bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7ca1fd-7099-4da2-a1c6-7788bf1a9bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321fc18c-e227-4db6-83f0-b81272fdb3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Volume c3975b24-3dd8-4922-8dcf-66ab8484bbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff', 'volume_size': 1}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:14 devstack sudo[84338]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4" returned: 0 in 1.377s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:36:14 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Converted 1024.00 MB image at 195.70 MB/s
Apr 16 02:36:14 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:14 devstack sudo[84350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524
Apr 16 02:36:14 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:15 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" returned: 0 in 0.651s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" released by "_copy_volume_from_snapshot" :: held 9.759s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-ecdb4390-98d3-4974-8e0a-e6afbba18ad0-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" released by "_create_volume_from_snapshot" :: held 9.797s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.809s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5e3669fc-a7da-4276-b83e-1c208ae6a3f9,created_at=2026-04-16T00:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-449492245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5e3669fc-a7da-4276-b83e-1c208ae6a3f9,host='devstack@QuobyteHD#QuobyteHD',id=c3975b24-3dd8-4922-8dcf-66ab8484bbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8747143d2194d3aacf3afbfd8ed2a82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:14Z,use_quota=True,user_id='69001f86169a497081a676d4d41e5531',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(596b50f0-ed9c-42d5-87e2-2b1b88fbd723),volume_type_id=596b50f0-ed9c-42d5-87e2-2b1b88fbd723)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Creating volume c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:36:15 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:36:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:15 devstack sudo[84371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff 1073741824
Apr 16 02:36:15 devstack sudo[84371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:15 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4fa17741-e94b-4a8c-b0d9-085ba5a293e0 tempest-GroupSnapshotsTest-1816305183 None] Create group from source-snapshot-ef6df0e0-5a5d-4ce5-8619-a8d5b92dbf99 completed successfully.
Apr 16 02:36:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:16 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e587695-bef9-40bf-ba66-bd31f7fb6c4a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:16 devstack sudo[84403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524
Apr 16 02:36:16 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:16 devstack sudo[84371]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff 1073741824" returned: 0 in 1.195s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:16 devstack sudo[84406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff
Apr 16 02:36:16 devstack sudo[84406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:17 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Acquiring lock "cinder-de592c33-df20-427b-9eb0-aba2790f56d0-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" returned: 0 in 0.741s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:17 devstack sudo[84406]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff" returned: 0 in 0.606s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:17 devstack sudo[84412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524
Apr 16 02:36:17 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "cinder-de592c33-df20-427b-9eb0-aba2790f56d0-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321fc18c-e227-4db6-83f0-b81272fdb3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef544be-4ef5-4564-97c9-8dce4e0f3bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:17 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Volume volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff (c3975b24-3dd8-4922-8dcf-66ab8484bbff): created successfully
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef544be-4ef5-4564-97c9-8dce4e0f3bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Flow 'volume_create_manager' (37b3ba68-560f-4df9-9cd3-91cbfb2b9352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:17 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3faee431-468a-49a4-9609-3c3dc8d13130 tempest-GroupSnapshotsV319Test-2003686330 None] Created volume successfully.
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Acquiring lock "cinder-quobyte-de592c33-df20-427b-9eb0-aba2790f56d0" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "cinder-quobyte-de592c33-df20-427b-9eb0-aba2790f56d0" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39a9421-b650-4d60-ac86-953872594a2f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:17 devstack sudo[84414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0
Apr 16 02:36:17 devstack sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:17 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" returned: 0 in 0.611s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-cd81f1f9-b13f-4ef2-91b9-d35dc62e5524" released by "delete_volume" :: held 1.399s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['c3d3ebb6-93bf-4fbf-96f1-fa5cbed09a19'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:17 devstack cinder-volume[83205]: WARNING cinder.quota [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-544702915 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-544702915, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:17 devstack cinder-volume[83205]: WARNING cinder.quota [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-544702915 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-544702915, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:17 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['29b8965c-6d27-4f91-a19f-10d7cbc4373c', 'e77fcebf-5e81-47cd-bef8-b52b6187ccd3', '2dbd8761-a3a7-4c4e-baf8-00562c7a2c8f', '172f1893-2f55-4b4f-a20f-1c2babde7805'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:18 devstack sudo[84420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:18 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:18 devstack sudo[84414]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0" returned: 0 in 0.652s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:18 devstack sudo[84422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0
Apr 16 02:36:18 devstack sudo[84422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:18 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.582s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1d1b4c23-c60c-4422-ad90-4b73fd6b2d15 tempest-GroupSnapshotsTest-1816305183 None] Delete group completed successfully.
Apr 16 02:36:18 devstack sudo[84422]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-de592c33-df20-427b-9eb0-aba2790f56d0" returned: 0 in 0.554s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "cinder-quobyte-de592c33-df20-427b-9eb0-aba2790f56d0" released by "delete_volume" :: held 1.276s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] GroupSnapshot b2caccbe-b38a-4120-80bf-18b0d59ec470: creating.
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Group snapshot b2caccbe-b38a-4120-80bf-18b0d59ec470: creating. {{(pid=83205) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Creating offline snapshot d18b4913-c384-43c7-a58f-8c5f484e0b3d of volume c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:36:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot ef6df0e0-5a5d-4ce5-8619-a8d5b92dbf99: deleting
Apr 16 02:36:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot ef6df0e0-5a5d-4ce5-8619-a8d5b92dbf99: deleting {{(pid=83205) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-14612747-10ac-4fee-93a4-824fb257d2b4" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Created reservations ['2ebb539c-69ad-45c3-b1c3-8b68d8adc1cc', 'b760da82-4342-4989-827e-59ca8d2a28f5', '9ec75d81-d839-483f-8286-4c17fcf97c13', '95e8e66e-4c7b-456f-b44d-8bd186be8644'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1572cf-849e-4b2f-8dfb-998ac01605ed]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-14612747-10ac-4fee-93a4-824fb257d2b4" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-ecdb4390-98d3-4974-8e0a-e6afbba18ad0" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-ecdb4390-98d3-4974-8e0a-e6afbba18ad0" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Deleting offline snapshot ecdb4390-98d3-4974-8e0a-e6afbba18ad0 of volume 14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:36:19 devstack sudo[84426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff
Apr 16 02:36:19 devstack sudo[84426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] snapshot_file for this snap is: volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6699206c-c107-45b1-9625-3cb7a8e2b344]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:19 devstack sudo[84431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:19 devstack sudo[84431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:19 devstack sudo[84429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0
Apr 16 02:36:19 devstack sudo[84429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:20 devstack sudo[84426]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff" returned: 0 in 1.148s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:20 devstack sudo[84442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d 1G
Apr 16 02:36:20 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:20 devstack sudo[84429]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0" returned: 0 in 1.201s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14612747-10ac-4fee-93a4-824fb257d2b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:36:20 devstack sudo[84431]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.193s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:20 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Deleted volume successfully.
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d544186-99f6-4d59-9321-737d205dd25f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a5603ffb-7603-4fb5-b796-e4dd60753196 tempest-ServerRescueNegativeTestJSON-1075683699 None] Lock "cinder-de592c33-df20-427b-9eb0-aba2790f56d0-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:20 devstack sudo[84447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4
Apr 16 02:36:20 devstack sudo[84447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:21 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d 1G" returned: 0 in 1.406s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:21 devstack sudo[84484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d
Apr 16 02:36:21 devstack sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:21 devstack sudo[84447]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4" returned: 0 in 1.328s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:21 devstack sudo[84488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0
Apr 16 02:36:21 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:22 devstack sudo[84484]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d" returned: 0 in 1.188s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:22 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:22 devstack sudo[84503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d
Apr 16 02:36:22 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:23 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0" returned: 0 in 1.226s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:23 devstack sudo[84517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0
Apr 16 02:36:23 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:23 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d" returned: 0 in 0.566s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:23 devstack sudo[84521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.info
Apr 16 02:36:23 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:23 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4.ecdb4390-98d3-4974-8e0a-e6afbba18ad0" returned: 0 in 0.636s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-ecdb4390-98d3-4974-8e0a-e6afbba18ad0" released by "_delete_snapshot" :: held 4.664s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-14612747-10ac-4fee-93a4-824fb257d2b4" released by "delete_snapshot" :: held 4.733s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:23 devstack cinder-volume[83205]: WARNING cinder.quota [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-544702915 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-544702915, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['65811d84-7f49-4445-888b-3c5b0b8ad56c', '389da855-1784-47e8-b95a-97239959d88d', 'c4b966c5-a688-4f75-aacb-1c48c40cda3d', '3edff2b6-4968-4084-b49f-e64a080616c7'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:23 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2443ec2a-fc76-48ec-9586-ea438e483cf7 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot ef6df0e0-5a5d-4ce5-8619-a8d5b92dbf99: deleted successfully
Apr 16 02:36:23 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.info" returned: 0 in 0.621s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:23 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:24 devstack sudo[84527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.info
Apr 16 02:36:24 devstack sudo[84527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:24 devstack sudo[84527]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.info" returned: 0 in 0.449s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.559s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4bcb9cd9-e1f8-4026-a2c5-1744a9b18f89 tempest-GroupSnapshotsV319Test-2003686330 None] group_snapshot b2caccbe-b38a-4120-80bf-18b0d59ec470: created successfully
Apr 16 02:36:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-14612747-10ac-4fee-93a4-824fb257d2b4" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-14612747-10ac-4fee-93a4-824fb257d2b4" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:24 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e90aac7-fb6d-4369-908b-36a5c142648b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:24 devstack sudo[84532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4
Apr 16 02:36:24 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:25 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4" returned: 0 in 0.557s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:25 devstack sudo[84537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4
Apr 16 02:36:25 devstack sudo[84537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] group_snapshot b2caccbe-b38a-4120-80bf-18b0d59ec470: deleting
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] group_snapshot b2caccbe-b38a-4120-80bf-18b0d59ec470: deleting {{(pid=83205) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Acquiring lock "cinder-quobyte-c3975b24-3dd8-4922-8dcf-66ab8484bbff" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "cinder-quobyte-c3975b24-3dd8-4922-8dcf-66ab8484bbff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Acquiring lock "cinder-quobyte-d18b4913-c384-43c7-a58f-8c5f484e0b3d" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "cinder-quobyte-d18b4913-c384-43c7-a58f-8c5f484e0b3d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Deleting offline snapshot d18b4913-c384-43c7-a58f-8c5f484e0b3d of volume c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] snapshot_file for this snap is: volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e06363-898e-4834-a5c5-61ff6bf36ab6]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:25 devstack sudo[84539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d
Apr 16 02:36:25 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:26 devstack sudo[84537]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14612747-10ac-4fee-93a4-824fb257d2b4" returned: 0 in 0.762s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-14612747-10ac-4fee-93a4-824fb257d2b4" released by "delete_volume" :: held 1.361s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['ab00281e-0313-42d3-a403-b01a68e773d7'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:26 devstack cinder-volume[83205]: WARNING cinder.db.sqlalchemy.api [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-544702915']
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['084011b4-3911-4a37-ad97-0a66006f948e', '52fdb7f9-bda0-4b96-8e6e-5e3c44d4aab9', 'de13f36e-7784-4288-ab5a-6fceb5ae46f3', '6d259191-72a6-4b29-b397-d2a2e72b85bd'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:26 devstack sudo[84546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:26 devstack sudo[84546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:26 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d" returned: 0 in 0.661s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b0deb-168d-4b26-97e2-e3244ad4ab33]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:26 devstack sudo[84548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff
Apr 16 02:36:26 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:26 devstack sudo[84546]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.458s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:26 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:26 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7030f430-511a-4bb3-bd10-689baef5f890 tempest-GroupSnapshotsTest-1816305183 None] Delete group completed successfully.
Apr 16 02:36:27 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff" returned: 0 in 0.747s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:27 devstack sudo[84558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d
Apr 16 02:36:27 devstack sudo[84558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-deafb187-fd9b-45dd-a31a-f3db64c8ebe4 tempest-GroupSnapshotsTest-1816305183 None] Group tempest-GroupSnapshotsTest-Group-1992053609: creating
Apr 16 02:36:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-deafb187-fd9b-45dd-a31a-f3db64c8ebe4 tempest-GroupSnapshotsTest-1816305183 None] Group tempest-GroupSnapshotsTest-Group-1992053609: created successfully
Apr 16 02:36:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-deafb187-fd9b-45dd-a31a-f3db64c8ebe4 tempest-GroupSnapshotsTest-1816305183 None] Create group completed successfully.
Apr 16 02:36:27 devstack sudo[84558]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d" returned: 0 in 0.576s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:27 devstack sudo[84563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d
Apr 16 02:36:27 devstack sudo[84563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:28 devstack sudo[84563]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff.d18b4913-c384-43c7-a58f-8c5f484e0b3d" returned: 0 in 0.478s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "cinder-quobyte-d18b4913-c384-43c7-a58f-8c5f484e0b3d" released by "_delete_snapshot" :: held 2.524s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "cinder-quobyte-c3975b24-3dd8-4922-8dcf-66ab8484bbff" released by "delete_snapshot" :: held 2.559s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:28 devstack cinder-volume[83205]: WARNING cinder.quota [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1535404252 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1535404252, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:28 devstack cinder-volume[83205]: WARNING cinder.quota [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1535404252 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1535404252, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:28 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] Created reservations ['a41cb258-60c5-4328-84c3-7a8ece0e4703', '03841b8a-f89e-4542-996f-991a985c3236', '39d49ce6-8791-4173-bf56-79498b06229d', '584773d1-5016-4381-b3b8-2c115e5116a2'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a11eb558-d51f-479d-a7c7-ed7fa1c74bc8 tempest-GroupSnapshotsV319Test-2003686330 None] group_snapshot b2caccbe-b38a-4120-80bf-18b0d59ec470: deleted successfully
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (fa5cdaea-13ab-4ebe-ae20-ee7da878fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5a7170-1b3e-42b1-a1fc-fa77260e2535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Acquiring lock "cinder-quobyte-c3975b24-3dd8-4922-8dcf-66ab8484bbff" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b5a7170-1b3e-42b1-a1fc-fa77260e2535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377471243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff63770f-b40c-4c72-98a5-af83f0a0361b,host='devstack@QuobyteHD#QuobyteHD',id=a4ae12d1-4645-4939-8cb5-52e621448f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:29Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96d6c971-1276-4638-8308-0a9214d9c9f0),volume_type_id=96d6c971-1276-4638-8308-0a9214d9c9f0)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc552395-0a1a-4cde-84a5-79f80508b772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc552395-0a1a-4cde-84a5-79f80508b772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589a704f-26f2-47f6-9765-5672a588b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589a704f-26f2-47f6-9765-5672a588b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ae12d1-4645-4939-8cb5-52e621448f87', 'volume_name': 'volume-a4ae12d1-4645-4939-8cb5-52e621448f87', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99f8617-aed8-4a3a-b558-f3ad4d887b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99f8617-aed8-4a3a-b558-f3ad4d887b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffcb4a7-17b6-4c2d-a0b7-f4bbc661151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:29 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Volume a4ae12d1-4645-4939-8cb5-52e621448f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ae12d1-4645-4939-8cb5-52e621448f87', 'volume_size': 1}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ff63770f-b40c-4c72-98a5-af83f0a0361b,created_at=2026-04-16T00:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377471243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff63770f-b40c-4c72-98a5-af83f0a0361b,host='devstack@QuobyteHD#QuobyteHD',id=a4ae12d1-4645-4939-8cb5-52e621448f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:29Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96d6c971-1276-4638-8308-0a9214d9c9f0),volume_type_id=96d6c971-1276-4638-8308-0a9214d9c9f0)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Creating volume a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:36:29 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "cinder-quobyte-c3975b24-3dd8-4922-8dcf-66ab8484bbff" acquired by "delete_volume" :: waited 0.058s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:29 devstack sudo[84639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 1073741824
Apr 16 02:36:29 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9741804-6436-43e9-9f19-3adc2b2be258]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:29 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff
Apr 16 02:36:29 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:29 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 1073741824" returned: 0 in 0.642s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:29 devstack sudo[84651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87
Apr 16 02:36:29 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:29 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff" returned: 0 in 0.686s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:29 devstack sudo[84653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff
Apr 16 02:36:29 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:30 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87" returned: 0 in 0.595s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffcb4a7-17b6-4c2d-a0b7-f4bbc661151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ae12d1-4645-4939-8cb5-52e621448f87', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd49b68c-1623-4203-b692-e73cce1d3b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:30 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Volume volume-a4ae12d1-4645-4939-8cb5-52e621448f87 (a4ae12d1-4645-4939-8cb5-52e621448f87): created successfully
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd49b68c-1623-4203-b692-e73cce1d3b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (fa5cdaea-13ab-4ebe-ae20-ee7da878fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:30 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-75cfc8b5-25e8-474d-84dc-baf9b42d6188 tempest-GroupSnapshotsTest-1816305183 None] Created volume successfully.
Apr 16 02:36:30 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c3975b24-3dd8-4922-8dcf-66ab8484bbff" returned: 0 in 0.659s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "cinder-quobyte-c3975b24-3dd8-4922-8dcf-66ab8484bbff" released by "delete_volume" :: held 1.376s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Created reservations ['4aee0f5f-8290-494b-bcd4-37cbae44b565'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:30 devstack cinder-volume[83205]: WARNING cinder.quota [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1535404252 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1535404252, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Created reservations ['7531d021-7b55-4360-8e9d-8d91b28150ff', '376d6ed2-ba4a-40c7-b590-e3ac7eb03287', '4382d1c9-0682-43a4-bc13-e69f81484534', 'e75eeaa5-5ab0-4acf-a6fb-09e00f9ae378'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:30 devstack sudo[84658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:30 devstack sudo[84658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:31 devstack sudo[84658]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.445s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0342f661-7e02-4cf5-be7e-1924c6924ce2 tempest-GroupSnapshotsV319Test-2003686330 None] Delete group completed successfully.
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (d213fc5c-d8a9-47cd-adcb-ec287aff3d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f87cae-e432-4ba1-903e-b2f5ed37379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f87cae-e432-4ba1-903e-b2f5ed37379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515432988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff63770f-b40c-4c72-98a5-af83f0a0361b,host='devstack@QuobyteHD#QuobyteHD',id=1a014a76-0512-41c9-8c29-f9661b1acf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:32Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96d6c971-1276-4638-8308-0a9214d9c9f0),volume_type_id=96d6c971-1276-4638-8308-0a9214d9c9f0)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257c971b-a55a-40ad-9488-ec6ff4dde516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257c971b-a55a-40ad-9488-ec6ff4dde516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ea2ac0-d9c1-4c14-a702-f7b7a57e88bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ea2ac0-d9c1-4c14-a702-f7b7a57e88bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a014a76-0512-41c9-8c29-f9661b1acf01', 'volume_name': 'volume-1a014a76-0512-41c9-8c29-f9661b1acf01', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8997c7-1194-4d37-82d0-40f1085390f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8997c7-1194-4d37-82d0-40f1085390f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473b1cbd-9fce-4cb7-bd00-2d6e56c1a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:31 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Volume 1a014a76-0512-41c9-8c29-f9661b1acf01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a014a76-0512-41c9-8c29-f9661b1acf01', 'volume_size': 1}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ff63770f-b40c-4c72-98a5-af83f0a0361b,created_at=2026-04-16T00:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515432988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff63770f-b40c-4c72-98a5-af83f0a0361b,host='devstack@QuobyteHD#QuobyteHD',id=1a014a76-0512-41c9-8c29-f9661b1acf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:32Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96d6c971-1276-4638-8308-0a9214d9c9f0),volume_type_id=96d6c971-1276-4638-8308-0a9214d9c9f0)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Creating volume 1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:36:31 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:36:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:31 devstack sudo[84662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 1073741824
Apr 16 02:36:31 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Flow 'volume_create_manager' (3d11d88c-ba6b-48e0-a3a9-3a59eba2d6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfb07af-7144-4d37-8027-1109165277e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfb07af-7144-4d37-8027-1109165277e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-806567578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4b733c-441e-4ce4-a4b9-13af8805dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449ca7a336274cf993ef730a150494c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:32Z,use_quota=True,user_id='89fa75630290474fa80fdbde7130b808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c6567a-42be-4fc7-88aa-cc8969feb702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c6567a-42be-4fc7-88aa-cc8969feb702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449807e4-bd4c-41a7-ab28-360ebd1a5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449807e4-bd4c-41a7-ab28-360ebd1a5739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4b733c-441e-4ce4-a4b9-13af8805dcf8', 'volume_name': 'volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0782899e-56f1-401a-acb5-b6edf2d606c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0782899e-56f1-401a-acb5-b6edf2d606c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57eccc0c-99aa-4d4b-b77b-1c4ac94bc31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:32 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Volume 5c4b733c-441e-4ce4-a4b9-13af8805dcf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8', 'volume_size': 1}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:32 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 1073741824" returned: 0 in 0.630s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:32 devstack sudo[84667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01
Apr 16 02:36:32 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:32 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01" returned: 0 in 0.518s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-806567578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4b733c-441e-4ce4-a4b9-13af8805dcf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='449ca7a336274cf993ef730a150494c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:32Z,use_quota=True,user_id='89fa75630290474fa80fdbde7130b808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Creating volume 5c4b733c-441e-4ce4-a4b9-13af8805dcf8 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:36:32 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:36:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473b1cbd-9fce-4cb7-bd00-2d6e56c1a426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a014a76-0512-41c9-8c29-f9661b1acf01', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:33 devstack sudo[84670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8 1073741824
Apr 16 02:36:33 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a0cdb6-7445-4e4d-9438-3a363a4d92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:33 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Volume volume-1a014a76-0512-41c9-8c29-f9661b1acf01 (1a014a76-0512-41c9-8c29-f9661b1acf01): created successfully
Apr 16 02:36:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a0cdb6-7445-4e4d-9438-3a363a4d92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (d213fc5c-d8a9-47cd-adcb-ec287aff3d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:33 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4bade156-8062-4114-87db-e1cd23774077 tempest-GroupSnapshotsTest-1816305183 None] Created volume successfully.
Apr 16 02:36:33 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8 1073741824" returned: 0 in 0.652s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:33 devstack sudo[84675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8
Apr 16 02:36:33 devstack sudo[84675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:34 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ce4bc6d0-4110-43d2-b0e7-d77eb843c98e tempest-GroupSnapshotsTest-1816305183 None] Update group completed successfully.
Apr 16 02:36:34 devstack sudo[84675]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8" returned: 0 in 0.837s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:36:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57eccc0c-99aa-4d4b-b77b-1c4ac94bc31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa1ac4a-778d-46a2-a045-9e7e50c250ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:34 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Volume volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8 (5c4b733c-441e-4ce4-a4b9-13af8805dcf8): created successfully
Apr 16 02:36:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa1ac4a-778d-46a2-a045-9e7e50c250ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Flow 'volume_create_manager' (3d11d88c-ba6b-48e0-a3a9-3a59eba2d6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:34 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-151d0c38-cc3e-47ea-b579-b9627a814acc tempest-VolumesAdminNegativeTest-1802353242 None] Created volume successfully.
Apr 16 02:36:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3f5699c3-f916-41e7-9f1b-788a1d561fe5 tempest-GroupsV314Test-121767304 None] Group tempest-GroupsV314Test-Group-1669702346: creating
Apr 16 02:36:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3f5699c3-f916-41e7-9f1b-788a1d561fe5 tempest-GroupsV314Test-121767304 None] Group tempest-GroupsV314Test-Group-1669702346: created successfully
Apr 16 02:36:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3f5699c3-f916-41e7-9f1b-788a1d561fe5 tempest-GroupsV314Test-121767304 None] Create group completed successfully.
Apr 16 02:36:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ba9e2322-559c-4aa8-aa2f-a920b5848dd5 tempest-GroupSnapshotsTest-1816305183 None] Update group completed successfully.
Apr 16 02:36:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Acquiring lock "cinder-5c4b733c-441e-4ce4-a4b9-13af8805dcf8-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Lock "cinder-5c4b733c-441e-4ce4-a4b9-13af8805dcf8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Acquiring lock "cinder-quobyte-5c4b733c-441e-4ce4-a4b9-13af8805dcf8" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Lock "cinder-quobyte-5c4b733c-441e-4ce4-a4b9-13af8805dcf8" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:35 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[267823a9-db5f-4f38-a45b-21da3f182801]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:36 devstack sudo[84682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8
Apr 16 02:36:36 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:36 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8" returned: 0 in 0.628s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:36 devstack sudo[84689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8
Apr 16 02:36:36 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:36 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-45b91ed7-5f2b-4caa-b85a-d36470840ba9 tempest-GroupSnapshotsTest-1816305183 None] Update group completed successfully.
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Flow 'volume_create_manager' (86d0ad0a-f032-4268-a54a-613179be154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6994cb-55df-455f-8742-406a6d13276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6994cb-55df-455f-8742-406a6d13276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2059574472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6c2396b-70f9-4761-ab00-cd21404f0694,host='devstack@QuobyteHD#QuobyteHD',id=b1fd8d25-93d6-47ef-8840-74a8cc67e0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6d6a978634257a1e925a9b123860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:37Z,use_quota=True,user_id='07c28ac5d3be4977acf09ed0874a8556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf349978-9227-4828-9206-09758a380b2d),volume_type_id=cf349978-9227-4828-9206-09758a380b2d)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaa1ede-bd2c-4f9a-a97f-75f86b9f91a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaa1ede-bd2c-4f9a-a97f-75f86b9f91a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ebe16b-a508-4581-abb8-e7755d9b0058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ebe16b-a508-4581-abb8-e7755d9b0058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fd8d25-93d6-47ef-8840-74a8cc67e0e0', 'volume_name': 'volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc18741-71b4-4ca2-a886-7693acb6f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc18741-71b4-4ca2-a886-7693acb6f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f35d507-a236-4d3f-9d7c-1f7d428ebbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:36 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Volume b1fd8d25-93d6-47ef-8840-74a8cc67e0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0', 'volume_size': 1}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b6c2396b-70f9-4761-ab00-cd21404f0694,created_at=2026-04-16T00:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2059574472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6c2396b-70f9-4761-ab00-cd21404f0694,host='devstack@QuobyteHD#QuobyteHD',id=b1fd8d25-93d6-47ef-8840-74a8cc67e0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6d6a978634257a1e925a9b123860e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:36:37Z,use_quota=True,user_id='07c28ac5d3be4977acf09ed0874a8556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf349978-9227-4828-9206-09758a380b2d),volume_type_id=cf349978-9227-4828-9206-09758a380b2d)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Creating volume b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:36:36 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:36:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:36 devstack sudo[84691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 1073741824
Apr 16 02:36:36 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:37 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5c4b733c-441e-4ce4-a4b9-13af8805dcf8" returned: 0 in 0.686s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Lock "cinder-quobyte-5c4b733c-441e-4ce4-a4b9-13af8805dcf8" released by "delete_volume" :: held 1.344s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Created reservations ['071e8570-2620-4ec5-8d8f-48958ec79f80', '2dc8091a-ffd4-40e2-a0ab-47a9a4fb9242', 'a4c06d32-cd57-479c-800a-3317782bfcf1', '517d0ab5-bec3-4457-99c9-21089f12c1a2'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:37 devstack sudo[84694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:37 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:37 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 1073741824" returned: 0 in 0.658s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:37 devstack sudo[84699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0
Apr 16 02:36:37 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:37 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.502s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Deleted volume successfully.
Apr 16 02:36:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0aa8a3f6-9f35-45d1-ab4d-a7462e7d2534 tempest-VolumesAdminNegativeTest-1802353242 None] Lock "cinder-5c4b733c-441e-4ce4-a4b9-13af8805dcf8-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f2cda02d-a9dd-4495-a810-2be44b5b84f6 tempest-GroupSnapshotsTest-1816305183 None] Update group completed successfully.
Apr 16 02:36:38 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" returned: 0 in 0.553s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:36:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f35d507-a236-4d3f-9d7c-1f7d428ebbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe5dfd-0b7c-4c08-8ca5-3d196728be10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:38 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Volume volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 (b1fd8d25-93d6-47ef-8840-74a8cc67e0e0): created successfully
Apr 16 02:36:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe5dfd-0b7c-4c08-8ca5-3d196728be10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Flow 'volume_create_manager' (86d0ad0a-f032-4268-a54a-613179be154d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-10c752f9-1ac8-4b88-ab68-d7d0f17242a7 tempest-GroupsV314Test-121767304 None] Created volume successfully.
Apr 16 02:36:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] GroupSnapshot 55993c6c-b9c9-40ad-9746-5e97d79ed079: creating.
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Group snapshot 55993c6c-b9c9-40ad-9746-5e97d79ed079: creating. {{(pid=83205) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Creating offline snapshot b8749f57-37a0-47ad-a678-d45fbecef7e6 of volume 1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[26edeedd-9ba9-40f8-a8db-c9a460ef2392]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:39 devstack sudo[84712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01
Apr 16 02:36:39 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:39 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01" returned: 0 in 0.630s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:39 devstack sudo[84736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 1G
Apr 16 02:36:39 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:40 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 1G" returned: 0 in 0.684s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a014a76-0512-41c9-8c29-f9661b1acf01 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:40 devstack sudo[84742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a014a76-0512-41c9-8c29-f9661b1acf01 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6
Apr 16 02:36:40 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:41 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a014a76-0512-41c9-8c29-f9661b1acf01 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6" returned: 0 in 0.563s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:41 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:41 devstack sudo[84749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6
Apr 16 02:36:41 devstack sudo[84749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:41 devstack sudo[84749]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6" returned: 0 in 0.483s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:41 devstack sudo[84753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.info
Apr 16 02:36:41 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:42 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.info" returned: 0 in 0.624s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:42 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:42 devstack sudo[84756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.info
Apr 16 02:36:42 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:42 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.info" returned: 0 in 0.527s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.568s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Creating offline snapshot f9a9ccb7-86aa-41ca-90be-1971e190f67e of volume a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9fe01d-3578-499d-986d-ed2d54e6d436]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:42 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87
Apr 16 02:36:42 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:43 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87" returned: 0 in 0.556s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:43 devstack sudo[84765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e 1G
Apr 16 02:36:43 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:44 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e 1G" returned: 0 in 0.601s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae12d1-4645-4939-8cb5-52e621448f87 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:44 devstack sudo[84770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae12d1-4645-4939-8cb5-52e621448f87 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e
Apr 16 02:36:44 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:44 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4ae12d1-4645-4939-8cb5-52e621448f87 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e" returned: 0 in 0.596s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:44 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:44 devstack sudo[84776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e
Apr 16 02:36:44 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:45 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e" returned: 0 in 0.524s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:45 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:UPDATE=128,cinder:SELECT=123,cinder:DELETE=6,cinder:INSERT=23 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:36:45 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=96,cinder:UPDATE=85,cinder:INSERT=23,cinder:DELETE=5 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:36:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:45 devstack sudo[84780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.info
Apr 16 02:36:45 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:45 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.info" returned: 0 in 0.548s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:45 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:45 devstack sudo[84784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.info
Apr 16 02:36:45 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:46 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.info" returned: 0 in 0.476s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.383s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.139s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:46 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Cloning volume b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 to volume cb2f8cde-aad8-49d5-8b41-81019e1e7551
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Creating offline snapshot b4f679b5-c2d7-4c54-afd3-ce77cd40a868 of volume b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b748ab0-2dc0-46c5-922d-e6626bfd143c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:46 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ad4543c3-1731-4c0d-be79-9e12de40e7bf tempest-GroupSnapshotsTest-1816305183 None] group_snapshot 55993c6c-b9c9-40ad-9746-5e97d79ed079: created successfully
Apr 16 02:36:46 devstack sudo[84787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0
Apr 16 02:36:46 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:46 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot 55993c6c-b9c9-40ad-9746-5e97d79ed079: deleting
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot 55993c6c-b9c9-40ad-9746-5e97d79ed079: deleting {{(pid=83205) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-1a014a76-0512-41c9-8c29-f9661b1acf01" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-1a014a76-0512-41c9-8c29-f9661b1acf01" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-b8749f57-37a0-47ad-a678-d45fbecef7e6" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-b8749f57-37a0-47ad-a678-d45fbecef7e6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Deleting offline snapshot b8749f57-37a0-47ad-a678-d45fbecef7e6 of volume 1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] snapshot_file for this snap is: volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c4b14-f417-4883-a93e-13302f692fda]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:46 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" returned: 0 in 0.611s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:46 devstack sudo[84793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 1G
Apr 16 02:36:46 devstack sudo[84792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6
Apr 16 02:36:46 devstack sudo[84792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:46 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:47 devstack sudo[84792]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6" returned: 0 in 0.694s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a014a76-0512-41c9-8c29-f9661b1acf01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:36:47 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 1G" returned: 0 in 0.625s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:47 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bbd8d7-32b0-4a21-b61c-55bbb52503b3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:47 devstack sudo[84802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868
Apr 16 02:36:47 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:47 devstack sudo[84803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01
Apr 16 02:36:47 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:48 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868" returned: 0 in 0.520s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:48 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:48 devstack sudo[84813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868
Apr 16 02:36:48 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:48 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01" returned: 0 in 0.683s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:48 devstack sudo[84819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6
Apr 16 02:36:48 devstack sudo[84819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:48 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868" returned: 0 in 0.528s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:48 devstack sudo[84825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.info
Apr 16 02:36:48 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:48 devstack sudo[84819]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6" returned: 0 in 0.586s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:48 devstack sudo[84830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6
Apr 16 02:36:48 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:49 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.info" returned: 0 in 0.444s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:49 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:49 devstack sudo[84833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.info
Apr 16 02:36:49 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:49 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01.b8749f57-37a0-47ad-a678-d45fbecef7e6" returned: 0 in 0.581s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-b8749f57-37a0-47ad-a678-d45fbecef7e6" released by "_delete_snapshot" :: held 2.643s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-1a014a76-0512-41c9-8c29-f9661b1acf01" released by "delete_snapshot" :: held 2.656s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-a4ae12d1-4645-4939-8cb5-52e621448f87" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-a4ae12d1-4645-4939-8cb5-52e621448f87" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-f9a9ccb7-86aa-41ca-90be-1971e190f67e" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-f9a9ccb7-86aa-41ca-90be-1971e190f67e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Deleting offline snapshot f9a9ccb7-86aa-41ca-90be-1971e190f67e of volume a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] snapshot_file for this snap is: volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[db64b912-d507-4b72-ae18-437ad114af8d]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:49 devstack sudo[84837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e
Apr 16 02:36:49 devstack sudo[84837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:49 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.info" returned: 0 in 0.548s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Acquiring lock "cinder-quobyte-cb2f8cde-aad8-49d5-8b41-81019e1e7551" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-cb2f8cde-aad8-49d5-8b41-81019e1e7551" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] snapshot: b4f679b5-c2d7-4c54-afd3-ce77cd40a868, volume: cb2f8cde-aad8-49d5-8b41-81019e1e7551,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac84c02-2e90-4220-a3a7-b39475767a24]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:49 devstack sudo[84839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868
Apr 16 02:36:49 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:50 devstack sudo[84837]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e" returned: 0 in 0.608s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4ae12d1-4645-4939-8cb5-52e621448f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b895f31-b97c-4de0-abc2-f907f772dc40]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:50 devstack sudo[84845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87
Apr 16 02:36:50 devstack sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:50 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868" returned: 0 in 0.643s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cf364f-771c-47b3-a893-fa850246d108]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:50 devstack sudo[84850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0
Apr 16 02:36:50 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:50 devstack sudo[84845]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87" returned: 0 in 0.640s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:50 devstack sudo[84864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e
Apr 16 02:36:50 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:50 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" returned: 0 in 0.587s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:36:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:50 devstack sudo[84866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551
Apr 16 02:36:50 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:51 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e" returned: 0 in 0.604s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:51 devstack sudo[84874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e
Apr 16 02:36:51 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:52 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87.f9a9ccb7-86aa-41ca-90be-1971e190f67e" returned: 0 in 1.483s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-f9a9ccb7-86aa-41ca-90be-1971e190f67e" released by "_delete_snapshot" :: held 3.410s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-a4ae12d1-4645-4939-8cb5-52e621448f87" released by "delete_snapshot" :: held 3.429s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:53 devstack cinder-volume[83205]: WARNING cinder.quota [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1604837057 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1604837057, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:53 devstack cinder-volume[83205]: WARNING cinder.quota [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1604837057 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1604837057, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:53 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['22fecfff-45e0-4d97-a7f6-f02182806b2e', 'ad4b4c89-951c-428c-8e93-914e6ab8a93d', '28f96ae9-d594-4e97-a44f-756255156648', 'a3113788-59bd-4c45-bc45-9774fd123ff5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:53 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['4670dbe4-ae89-432d-ab54-4c8a301dea01', '6b0a9d95-7911-43e5-9a02-147d5bd6d70a', '6e4c3aec-95fe-4442-b09e-160b836a9e4e', '1248b8e9-6998-413f-977a-0672edb030ac'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-594d5fb1-37cb-42e6-8baf-6bb2107707c5 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot 55993c6c-b9c9-40ad-9746-5e97d79ed079: deleted successfully
Apr 16 02:36:53 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551" returned: 0 in 2.774s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[777948a6-da3c-4621-9af6-1abef72f85ef]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:53 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0
Apr 16 02:36:53 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-1a014a76-0512-41c9-8c29-f9661b1acf01" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:54 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" returned: 0 in 0.949s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-1a014a76-0512-41c9-8c29-f9661b1acf01" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:54 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0, size 1024.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:36:54 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Converted 1024.00 MB image at 369.06 MB/s
Apr 16 02:36:54 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551 is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:36:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:54 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[569c26ba-c0ac-48af-aebc-9e8b989b5ca9]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:54 devstack sudo[84910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551
Apr 16 02:36:54 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:54 devstack sudo[84911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01
Apr 16 02:36:54 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:55 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551" returned: 0 in 0.646s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-cb2f8cde-aad8-49d5-8b41-81019e1e7551" released by "_copy_volume_from_snapshot" :: held 5.670s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Acquiring lock "cinder-quobyte-b4f679b5-c2d7-4c54-afd3-ce77cd40a868" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-b4f679b5-c2d7-4c54-afd3-ce77cd40a868" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Deleting offline snapshot b4f679b5-c2d7-4c54-afd3-ce77cd40a868 of volume b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] snapshot_file for this snap is: volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6554fac3-fdcc-41b0-bfdd-2f3063507840]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:55 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01" returned: 0 in 0.705s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:55 devstack sudo[84922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01
Apr 16 02:36:55 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:55 devstack sudo[84921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868
Apr 16 02:36:55 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:55 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1a014a76-0512-41c9-8c29-f9661b1acf01" returned: 0 in 0.548s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-1a014a76-0512-41c9-8c29-f9661b1acf01" released by "delete_volume" :: held 1.292s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-a4ae12d1-4645-4939-8cb5-52e621448f87" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-a4ae12d1-4645-4939-8cb5-52e621448f87" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:55 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868" returned: 0 in 0.619s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e210b6f2-04ee-4c08-bbba-c40f09db4708]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfdb6f5-d72b-400d-979d-29f5522f2f47]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:56 devstack sudo[84929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87
Apr 16 02:36:56 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:56 devstack sudo[84930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0
Apr 16 02:36:56 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:56 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87" returned: 0 in 0.568s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:56 devstack sudo[84939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87
Apr 16 02:36:56 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:56 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" returned: 0 in 0.689s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:56 devstack sudo[84942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868
Apr 16 02:36:56 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:57 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a4ae12d1-4645-4939-8cb5-52e621448f87" returned: 0 in 0.523s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-a4ae12d1-4645-4939-8cb5-52e621448f87" released by "delete_volume" :: held 1.134s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['8113e6e3-f364-4205-8ead-b986418da0a9'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:57 devstack cinder-volume[83205]: WARNING cinder.quota [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1604837057 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1604837057, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['56a1b982-2069-4b81-9f9e-bece176a09d8', '4af817d3-9b55-44bc-ab6f-9c4d5c3501d5', 'c90ecc22-80a3-400d-8721-2bb07764b6a6', '5fe19341-e250-44a4-8a8f-ebfa1e9efa8e'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:57 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868" returned: 0 in 0.593s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:57 devstack sudo[84949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868
Apr 16 02:36:57 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['88dd5f1a-a095-430a-b331-845d1dde9dc9', '06932116-04c1-4342-a069-80465c311a0b', '58d03645-dcd6-49c3-b9b0-988b0faa9c08', '39bd50a6-b362-4e42-9b80-a15f381cb4ad'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:57 devstack sudo[84951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:57 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:57 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0.b4f679b5-c2d7-4c54-afd3-ce77cd40a868" returned: 0 in 0.552s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-b4f679b5-c2d7-4c54-afd3-ce77cd40a868" released by "_delete_snapshot" :: held 2.515s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.616s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:57 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-607cf02d-9918-48b7-b5eb-44b5c049b4ef tempest-GroupsV314Test-121767304 None] Create group from source-group-b6c2396b-70f9-4761-ab00-cd21404f0694 completed successfully.
Apr 16 02:36:58 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.605s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:36:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-5ccfb1d5-20dd-4e7c-a6bf-2fb5929a15d6 tempest-GroupSnapshotsTest-1816305183 None] Delete group completed successfully.
Apr 16 02:36:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ab84f775-8a92-4287-91ec-84a173939314 tempest-GroupSnapshotsTest-1816305183 None] Group tempest-GroupSnapshotsTest-Group-2070671195: creating
Apr 16 02:36:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ab84f775-8a92-4287-91ec-84a173939314 tempest-GroupSnapshotsTest-1816305183 None] Group tempest-GroupSnapshotsTest-Group-2070671195: created successfully
Apr 16 02:36:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ab84f775-8a92-4287-91ec-84a173939314 tempest-GroupSnapshotsTest-1816305183 None] Create group completed successfully.
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Acquiring lock "cinder-quobyte-cb2f8cde-aad8-49d5-8b41-81019e1e7551" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-cb2f8cde-aad8-49d5-8b41-81019e1e7551" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d6549-41c2-4a5d-b341-616f195930e2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:58 devstack sudo[84955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551
Apr 16 02:36:58 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:58 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551" returned: 0 in 0.561s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:59 devstack sudo[84963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551
Apr 16 02:36:59 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:59 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb2f8cde-aad8-49d5-8b41-81019e1e7551" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-cb2f8cde-aad8-49d5-8b41-81019e1e7551" released by "delete_volume" :: held 1.054s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Created reservations ['df605d38-7347-45ca-8bb0-b451030cfcda'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:59 devstack cinder-volume[83205]: WARNING cinder.quota [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1242815747 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1242815747, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:59 devstack cinder-volume[83205]: WARNING cinder.quota [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1242815747 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1242815747, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Created reservations ['fe60411a-bd82-49e8-9ce1-6f7c13da9d6d', '5ef98d4a-9a70-4a6b-80e1-c9a73bdd7cda', '64955880-e7da-4e4a-8107-e98e895c46e6', 'a0506108-cf2a-4270-a4a5-2a4e18f9bc10'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:59 devstack sudo[84966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:59 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (8bad7ed8-fab1-434f-bd48-025b67f4a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b67cd33-9b14-46ed-a76c-84dd4e2a66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b67cd33-9b14-46ed-a76c-84dd4e2a66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1024304242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94ee0aa7-e4b5-4c55-bff8-2e2f407f1263,host='devstack@QuobyteHD#QuobyteHD',id=727b6820-1112-43de-b4ba-436318bb4e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:00Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3e30392-9291-4c88-99f4-440bc8eb8ca1),volume_type_id=c3e30392-9291-4c88-99f4-440bc8eb8ca1)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276a9573-e632-4a04-8c4b-9ce863391093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276a9573-e632-4a04-8c4b-9ce863391093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30be92e-7007-4bf9-811c-94fc14d107cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30be92e-7007-4bf9-811c-94fc14d107cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727b6820-1112-43de-b4ba-436318bb4e53', 'volume_name': 'volume-727b6820-1112-43de-b4ba-436318bb4e53', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e02c947-f8f9-4f0f-8af3-2284febbeb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e02c947-f8f9-4f0f-8af3-2284febbeb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5687742-95a7-4a5b-9714-44d2261f6dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:36:59 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Volume 727b6820-1112-43de-b4ba-436318bb4e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727b6820-1112-43de-b4ba-436318bb4e53', 'volume_size': 1}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=94ee0aa7-e4b5-4c55-bff8-2e2f407f1263,created_at=2026-04-16T00:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1024304242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=94ee0aa7-e4b5-4c55-bff8-2e2f407f1263,host='devstack@QuobyteHD#QuobyteHD',id=727b6820-1112-43de-b4ba-436318bb4e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118187e2ddcf498094218e7b16586b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:00Z,use_quota=True,user_id='1697a882d5964d928149ab6852490c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3e30392-9291-4c88-99f4-440bc8eb8ca1),volume_type_id=c3e30392-9291-4c88-99f4-440bc8eb8ca1)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Creating volume 727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:36:59 devstack sudo[85000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:36:59 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:36:59 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:36:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:00 devstack sudo[85002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 1073741824
Apr 16 02:37:00 devstack sudo[85002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:00 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.916s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Acquiring lock "cinder-quobyte-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" acquired by "delete_volume" :: waited 0.024s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e7efbf-5a21-45d8-8368-0bdf13876504]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:01 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.588s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:01 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e15b3d0f-5cd7-4245-975e-bba5e9b49f83 tempest-GroupsV314Test-121767304 None] Delete group completed successfully.
Apr 16 02:37:01 devstack sudo[85040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0
Apr 16 02:37:01 devstack sudo[85040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:01 devstack sudo[85002]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 1073741824" returned: 0 in 1.363s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:01 devstack sudo[85042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53
Apr 16 02:37:01 devstack sudo[85042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:02 devstack sudo[85040]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" returned: 0 in 0.920s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:02 devstack sudo[85042]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53" returned: 0 in 0.677s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:02 devstack sudo[85049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5687742-95a7-4a5b-9714-44d2261f6dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727b6820-1112-43de-b4ba-436318bb4e53', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:02 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b151d77a-9482-4b2d-9002-8e299fbfc578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:02 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Volume volume-727b6820-1112-43de-b4ba-436318bb4e53 (727b6820-1112-43de-b4ba-436318bb4e53): created successfully
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b151d77a-9482-4b2d-9002-8e299fbfc578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Flow 'volume_create_manager' (8bad7ed8-fab1-434f-bd48-025b67f4a24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-23bbd59c-149b-45b3-8ac9-3a3f1fbd46b3 tempest-GroupSnapshotsTest-1816305183 None] Created volume successfully.
Apr 16 02:37:02 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" returned: 0 in 0.515s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Lock "cinder-quobyte-b1fd8d25-93d6-47ef-8840-74a8cc67e0e0" released by "delete_volume" :: held 1.489s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Created reservations ['0ce37d79-0ad5-416f-a82b-f44a0313d117'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Created reservations ['73f716dd-4ec0-454c-a038-34c9f929559b', 'a2ba91fe-1131-444f-a519-542980a79b58', 'd1d41933-ea3b-4cda-8a06-9f34f4d97706', '7179d498-bc8f-4143-9634-ca61b1e619b7'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:02 devstack sudo[85052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:02 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] GroupSnapshot d2cceb52-a4ea-4ab3-b997-8f0c1ddcdcac: creating.
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Group snapshot d2cceb52-a4ea-4ab3-b997-8f0c1ddcdcac: creating. {{(pid=83205) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Creating offline snapshot 0a3090e7-f2fe-4330-a1d1-ccd0e5257dea of volume 727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c82c320-12cc-42a6-89cd-0ba642bd6ea1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:03 devstack sudo[85056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53
Apr 16 02:37:03 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.883s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:03 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:03 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e8aa59ae-ffab-43b8-986c-41ab62da4bf2 tempest-GroupsV314Test-121767304 None] Delete group completed successfully.
Apr 16 02:37:04 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53" returned: 0 in 0.831s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:04 devstack sudo[85065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea 1G
Apr 16 02:37:04 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:04 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea 1G" returned: 0 in 0.636s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727b6820-1112-43de-b4ba-436318bb4e53 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:05 devstack sudo[85073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727b6820-1112-43de-b4ba-436318bb4e53 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea
Apr 16 02:37:05 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:05 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727b6820-1112-43de-b4ba-436318bb4e53 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" returned: 0 in 0.769s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:05 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:37:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:05 devstack sudo[85078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea
Apr 16 02:37:05 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:06 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" returned: 0 in 0.582s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:06 devstack sudo[85081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.info
Apr 16 02:37:06 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:07 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.info" returned: 0 in 0.723s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:07 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 16 02:37:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:07 devstack sudo[85084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.info
Apr 16 02:37:07 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:07 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.info" returned: 0 in 0.643s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.291s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:07 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-eff11e72-85bc-45cb-a9ec-e43576e576f4 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot d2cceb52-a4ea-4ab3-b997-8f0c1ddcdcac: created successfully
Apr 16 02:37:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot d2cceb52-a4ea-4ab3-b997-8f0c1ddcdcac: deleting
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot d2cceb52-a4ea-4ab3-b997-8f0c1ddcdcac: deleting {{(pid=83205) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-727b6820-1112-43de-b4ba-436318bb4e53" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-727b6820-1112-43de-b4ba-436318bb4e53" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Deleting offline snapshot 0a3090e7-f2fe-4330-a1d1-ccd0e5257dea of volume 727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] snapshot_file for this snap is: volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[91263fec-a461-4f6c-899b-2de071b3902d]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:09 devstack sudo[85088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea
Apr 16 02:37:09 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:10 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" returned: 0 in 1.158s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-727b6820-1112-43de-b4ba-436318bb4e53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:10 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5755bf-17a6-43cb-a28c-b4966e9a82ee]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:10 devstack sudo[85095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53
Apr 16 02:37:10 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:11 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53" returned: 0 in 1.042s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:11 devstack sudo[85118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea
Apr 16 02:37:11 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:12 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" returned: 0 in 0.767s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:12 devstack sudo[85123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea
Apr 16 02:37:12 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:12 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53.0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" returned: 0 in 0.617s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-0a3090e7-f2fe-4330-a1d1-ccd0e5257dea" released by "_delete_snapshot" :: held 3.792s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-727b6820-1112-43de-b4ba-436318bb4e53" released by "delete_snapshot" :: held 3.825s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:13 devstack cinder-volume[83205]: WARNING cinder.quota [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-182481260 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-182481260, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:37:13 devstack cinder-volume[83205]: WARNING cinder.quota [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-182481260 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-182481260, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:37:13 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['ca98ba16-57b8-44d8-b8fc-f9f73bf10384', '05c956e6-ad70-4917-a9e3-51e80b47aa36', '0cfa74b1-0b85-4d10-9042-d6af41c4212f', 'd1ce60ed-e22d-4920-9bb0-0e3dd2d99760'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:13 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f0d9059d-7730-4bde-b87f-3c189fedf365 tempest-GroupSnapshotsTest-1816305183 None] group_snapshot d2cceb52-a4ea-4ab3-b997-8f0c1ddcdcac: deleted successfully
Apr 16 02:37:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "cinder-quobyte-727b6820-1112-43de-b4ba-436318bb4e53" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-727b6820-1112-43de-b4ba-436318bb4e53" acquired by "delete_volume" :: waited 0.018s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:13 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[05527a06-d572-45bb-82b6-609bca808a7e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:13 devstack sudo[85126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53
Apr 16 02:37:13 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:14 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53" returned: 0 in 0.598s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:14 devstack sudo[85131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53
Apr 16 02:37:14 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Flow 'volume_create_manager' (9a9bb758-c8c6-4879-a321-857421481628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c932d-792b-44a6-bc10-49d8ca1f6555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:15 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c932d-792b-44a6-bc10-49d8ca1f6555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-361889232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23245e7d-28ac-4b4f-a73f-4d34f3c719cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa2b1f455494db5984e881b66097d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:15Z,use_quota=True,user_id='0e56a67a2b874c70af189443a22dc984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983f0d6a-f88a-4c7d-8596-1877b7972e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983f0d6a-f88a-4c7d-8596-1877b7972e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3acf204-9a0b-42c2-a3a9-65b2d95f0551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3acf204-9a0b-42c2-a3a9-65b2d95f0551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23245e7d-28ac-4b4f-a73f-4d34f3c719cd', 'volume_name': 'volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace97dc5-2840-4005-ba29-616497af01cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace97dc5-2840-4005-ba29-616497af01cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639930ca-0f9b-463c-87eb-4c72a3eade3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:15 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd', 'volume_size': 1}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-361889232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23245e7d-28ac-4b4f-a73f-4d34f3c719cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caa2b1f455494db5984e881b66097d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:15Z,use_quota=True,user_id='0e56a67a2b874c70af189443a22dc984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Creating volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:15 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-727b6820-1112-43de-b4ba-436318bb4e53" returned: 0 in 0.852s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:15 devstack sudo[85138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd 1073741824
Apr 16 02:37:15 devstack sudo[85138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Lock "cinder-quobyte-727b6820-1112-43de-b4ba-436318bb4e53" released by "delete_volume" :: held 1.491s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['955922cf-b6e7-4237-b311-84e7bf6f3e4d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:15 devstack cinder-volume[83205]: WARNING cinder.quota [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-182481260 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-182481260, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Created reservations ['f7164293-877b-452e-b8b2-a1e7568a7425', 'b083d846-e0f9-425c-b35b-2e4f4c38f8b2', '392425b9-b6c9-4526-8d81-318725919716', 'bd43f478-95dd-405d-9bd2-2e5824bbe385'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:15 devstack sudo[85143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:15 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:15 devstack sudo[85138]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd 1073741824" returned: 0 in 0.648s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:16 devstack sudo[85150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd
Apr 16 02:37:16 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:16 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.675s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a9e8ea1b-4333-41ba-b985-9f4a00d464ae tempest-GroupSnapshotsTest-1816305183 None] Delete group completed successfully.
Apr 16 02:37:16 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" returned: 0 in 0.804s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639930ca-0f9b-463c-87eb-4c72a3eade3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9081b1-48a2-45be-929f-407de92b5386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:16 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Volume volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd (23245e7d-28ac-4b4f-a73f-4d34f3c719cd): created successfully
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9081b1-48a2-45be-929f-407de92b5386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Flow 'volume_create_manager' (9a9bb758-c8c6-4879-a321-857421481628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3dfa400b-8367-4c4a-b8b0-2504a84bb999 tempest-SnapshotsActionsTest-389848923 None] Created volume successfully.
Apr 16 02:37:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Creating offline snapshot 123ceb5b-dc2f-426e-8c09-66bc808ca33f of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:37:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc0202-2382-4a71-b187-3d9e6305c812]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:17 devstack sudo[85180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd
Apr 16 02:37:17 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:18 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" returned: 0 in 0.661s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:18 devstack sudo[85185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f 1G
Apr 16 02:37:18 devstack sudo[85185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:18 devstack sudo[85185]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f 1G" returned: 0 in 0.682s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:18 devstack sudo[85190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:18 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:19 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.681s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:19 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f is being set with open permissions: ugo+rw
Apr 16 02:37:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:19 devstack sudo[85199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:19 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:20 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.978s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:20 devstack sudo[85204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.info
Apr 16 02:37:20 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-500e0b72-734b-4357-80fd-7c0d6b4a6bec tempest-GroupsV320Test-1120676624 None] Group tempest-GroupsV320Test-Group-265018582: creating
Apr 16 02:37:21 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.info" returned: 0 in 1.024s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:21 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.info is being set with open permissions: ugo+rw
Apr 16 02:37:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-500e0b72-734b-4357-80fd-7c0d6b4a6bec tempest-GroupsV320Test-1120676624 None] Group tempest-GroupsV320Test-Group-265018582: created successfully
Apr 16 02:37:21 devstack sudo[85208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.info
Apr 16 02:37:21 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-500e0b72-734b-4357-80fd-7c0d6b4a6bec tempest-GroupsV320Test-1120676624 None] Create group completed successfully.
Apr 16 02:37:22 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.info" returned: 0 in 0.916s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.035s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:22 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7d5e1d0f-1201-480c-bba0-09e4c2127878 tempest-SnapshotsActionsTest-389848923 None] Create snapshot completed successfully
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Creating offline snapshot 26df9720-d0f0-4615-861a-2e03ab2a1f84 of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada4867-3351-4fce-a7cd-f0ed36803c4f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:23 devstack sudo[85252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:23 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Created reservations ['91f819a8-84f0-4edd-af5d-3776d4fa0cd5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:23 devstack sudo[85258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:23 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:24 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.671s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:24 devstack sudo[85266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 1G
Apr 16 02:37:24 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:24 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.624s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:24 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8dcf963e-250b-4150-a9cd-e14497cc2d68 tempest-GroupsV320Test-1120676624 None] Delete group completed successfully.
Apr 16 02:37:24 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 1G" returned: 0 in 0.678s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:24 devstack sudo[85274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84
Apr 16 02:37:24 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:25 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84" returned: 0 in 0.660s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:25 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 is being set with open permissions: ugo+rw
Apr 16 02:37:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:25 devstack sudo[85287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84
Apr 16 02:37:25 devstack sudo[85287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:26 devstack sudo[85287]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84" returned: 0 in 0.677s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:26 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7302aefa-b267-4dec-8a85-c77a85b2675c tempest-SnapshotsActionsTest-389848923 None] Create snapshot completed successfully
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-26df9720-d0f0-4615-861a-2e03ab2a1f84-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-26df9720-d0f0-4615-861a-2e03ab2a1f84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-26df9720-d0f0-4615-861a-2e03ab2a1f84" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-26df9720-d0f0-4615-861a-2e03ab2a1f84" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Deleting offline snapshot 26df9720-d0f0-4615-861a-2e03ab2a1f84 of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] snapshot_file for this snap is: volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d46a2-a25c-4563-94cf-89ed507435ea]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:26 devstack sudo[85291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84
Apr 16 02:37:26 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:27 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84" returned: 0 in 0.766s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:27 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff34ac8-1b6d-4b38-83c4-a594deae8d54]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:27 devstack sudo[85299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:27 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:28 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.709s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:28 devstack sudo[85304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84
Apr 16 02:37:28 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:29 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84" returned: 0 in 1.053s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:29 devstack sudo[85338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84
Apr 16 02:37:29 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:29 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.26df9720-d0f0-4615-861a-2e03ab2a1f84" returned: 0 in 0.605s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-26df9720-d0f0-4615-861a-2e03ab2a1f84" released by "_delete_snapshot" :: held 3.214s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" released by "delete_snapshot" :: held 3.235s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:30 devstack cinder-volume[83205]: WARNING cinder.quota [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Created reservations ['1eadd83b-a173-4cdc-b1a2-7843d7a88c87', '9cb5e3a6-3cc9-447d-ac60-b490fde051b5', 'a57122f0-db9b-4356-b481-05c6c3312f8d', 'eeff080c-9ca6-4b49-b354-00e75ab3ce2e'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:30 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Delete snapshot completed successfully.
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a84ea6a1-ea06-4966-8d37-30b763985333 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-26df9720-d0f0-4615-861a-2e03ab2a1f84-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Flow 'volume_create_manager' (14bb439a-67c7-4376-8b5b-35c86e0bd038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8a1e16-7868-4b7f-af3c-9a674bbf44b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8a1e16-7868-4b7f-af3c-9a674bbf44b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-733658565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05d81f1-b1ed-4393-977d-88e4b7419b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e958e6dbf74943b01040a47e738712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:30Z,use_quota=True,user_id='664a89f17b49450f92dce8a75b40d425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c1a707-fe3d-44eb-89fe-62e6f2e4e0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c1a707-fe3d-44eb-89fe-62e6f2e4e0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea6810a-2c86-4d2e-9ab4-78dd923b5f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea6810a-2c86-4d2e-9ab4-78dd923b5f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05d81f1-b1ed-4393-977d-88e4b7419b81', 'volume_name': 'volume-c05d81f1-b1ed-4393-977d-88e4b7419b81', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b778db-76c5-429c-a5b1-0de9740fb96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b778db-76c5-429c-a5b1-0de9740fb96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d764b246-b6b4-4133-8a7e-84135feab2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:30 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Volume c05d81f1-b1ed-4393-977d-88e4b7419b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05d81f1-b1ed-4393-977d-88e4b7419b81', 'volume_size': 1}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-733658565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05d81f1-b1ed-4393-977d-88e4b7419b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e958e6dbf74943b01040a47e738712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:30Z,use_quota=True,user_id='664a89f17b49450f92dce8a75b40d425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Creating volume c05d81f1-b1ed-4393-977d-88e4b7419b81 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:30 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:30 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81 1073741824
Apr 16 02:37:30 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:31 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81 1073741824" returned: 0 in 1.244s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:31 devstack sudo[85348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81
Apr 16 02:37:31 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Flow 'volume_create_manager' (ac296990-2e91-4c4b-912e-58d540e36278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d400e73f-abd5-49d5-817a-4bd50dae602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d400e73f-abd5-49d5-817a-4bd50dae602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1844729129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4204ea4-f3f6-40b2-8188-9f9ba6dac8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3941770e8aa8485c92d693d21aa77c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:32Z,use_quota=True,user_id='6fbcf53fd52d49f0bc68ca3e972ef922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b60a13-b517-45a3-91e3-646a74ce1b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b60a13-b517-45a3-91e3-646a74ce1b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a037d4-6b31-48ee-a49e-730ec09bf48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a037d4-6b31-48ee-a49e-730ec09bf48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4204ea4-f3f6-40b2-8188-9f9ba6dac8af', 'volume_name': 'volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc6bfd4-b1bf-48f8-9cb6-1455d906788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc6bfd4-b1bf-48f8-9cb6-1455d906788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a491234-9d10-415a-afeb-516971ba787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:32 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Volume b4204ea4-f3f6-40b2-8188-9f9ba6dac8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af', 'volume_size': 1}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:32 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81" returned: 0 in 0.537s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.594s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d764b246-b6b4-4133-8a7e-84135feab2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05d81f1-b1ed-4393-977d-88e4b7419b81', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d83ac1-1361-4b8d-9c54-d813c2ea64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Creating offline snapshot 7ae77bab-ce32-4a22-a174-17a70a17d949 of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:37:32 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Volume volume-c05d81f1-b1ed-4393-977d-88e4b7419b81 (c05d81f1-b1ed-4393-977d-88e4b7419b81): created successfully
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d83ac1-1361-4b8d-9c54-d813c2ea64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Flow 'volume_create_manager' (14bb439a-67c7-4376-8b5b-35c86e0bd038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a3941-2d6d-4506-bf70-520d79141cfd]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:32 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-fe5d9be8-2621-46f6-95ea-e0b25b67f0c8 tempest-ServersNegativeTestJSON-1654549274 None] Created volume successfully.
Apr 16 02:37:32 devstack sudo[85351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:32 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.782s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:33 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:33 devstack sudo[85356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 1G
Apr 16 02:37:33 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:33 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 1G" returned: 0 in 0.758s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:33 devstack sudo[85361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949
Apr 16 02:37:33 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Flow 'volume_create_manager' (c12a74c8-9523-4ac5-8366-ad43ed61c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e874fcbd-ef0c-4990-bbc5-21f78d8cc49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e874fcbd-ef0c-4990-bbc5-21f78d8cc49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-281438922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79bcabb-cb3c-4b1b-a992-978bd4534642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e958e6dbf74943b01040a47e738712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:34Z,use_quota=True,user_id='664a89f17b49450f92dce8a75b40d425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a76c85c-3385-44c4-9a01-0d84fcecd935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a76c85c-3385-44c4-9a01-0d84fcecd935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b19c3c7-1854-4cdf-8130-8658056fe4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b19c3c7-1854-4cdf-8130-8658056fe4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79bcabb-cb3c-4b1b-a992-978bd4534642', 'volume_name': 'volume-f79bcabb-cb3c-4b1b-a992-978bd4534642', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1c8ba4-ae44-4d05-ad5a-6becd24284d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1c8ba4-ae44-4d05-ad5a-6becd24284d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1333451-eebd-43a4-b0ed-cb42fdab250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:34 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Volume f79bcabb-cb3c-4b1b-a992-978bd4534642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79bcabb-cb3c-4b1b-a992-978bd4534642', 'volume_size': 1}
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:34 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949" returned: 0 in 0.783s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:34 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 is being set with open permissions: ugo+rw
Apr 16 02:37:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:34 devstack sudo[85369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949
Apr 16 02:37:34 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:35 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949" returned: 0 in 0.581s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.191s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1844729129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4204ea4-f3f6-40b2-8188-9f9ba6dac8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3941770e8aa8485c92d693d21aa77c1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:32Z,use_quota=True,user_id='6fbcf53fd52d49f0bc68ca3e972ef922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Creating volume b4204ea4-f3f6-40b2-8188-9f9ba6dac8af {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:35 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-432b5046-ffa7-415c-81ce-18579355666e tempest-SnapshotsActionsTest-389848923 None] Create snapshot completed successfully
Apr 16 02:37:35 devstack sudo[85372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af 1073741824
Apr 16 02:37:35 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:36 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af 1073741824" returned: 0 in 0.677s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:36 devstack sudo[85377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af
Apr 16 02:37:36 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-7ae77bab-ce32-4a22-a174-17a70a17d949-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-7ae77bab-ce32-4a22-a174-17a70a17d949-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-7ae77bab-ce32-4a22-a174-17a70a17d949" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-7ae77bab-ce32-4a22-a174-17a70a17d949" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Deleting offline snapshot 7ae77bab-ce32-4a22-a174-17a70a17d949 of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] snapshot_file for this snap is: volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e14171-af49-4271-a3a1-f7f16f630d72]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:36 devstack sudo[85379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949
Apr 16 02:37:36 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:36 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af" returned: 0 in 0.603s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.270s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-281438922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79bcabb-cb3c-4b1b-a992-978bd4534642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e958e6dbf74943b01040a47e738712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:34Z,use_quota=True,user_id='664a89f17b49450f92dce8a75b40d425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Creating volume f79bcabb-cb3c-4b1b-a992-978bd4534642 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:36 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a491234-9d10-415a-afeb-516971ba787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee1f463-1fa3-4d75-8a04-65d1c1616def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:36 devstack sudo[85382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642 1073741824
Apr 16 02:37:36 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Volume volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af (b4204ea4-f3f6-40b2-8188-9f9ba6dac8af): created successfully
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee1f463-1fa3-4d75-8a04-65d1c1616def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Flow 'volume_create_manager' (ac296990-2e91-4c4b-912e-58d540e36278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:36 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:36 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-10863c7e-58e7-4714-b632-05a27144d241 tempest-DeleteServersTestJSON-1337841203 None] Created volume successfully.
Apr 16 02:37:36 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949" returned: 0 in 0.683s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6965bf16-4e26-407d-9f45-c57cb0309c6b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:36 devstack sudo[85387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:36 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:37 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642 1073741824" returned: 0 in 0.645s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:37 devstack sudo[85392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642
Apr 16 02:37:37 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:37 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.732s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:37 devstack sudo[85397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949
Apr 16 02:37:37 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Flow 'volume_create_manager' (555606b7-96c7-4767-972f-c7ba193fefce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095add07-51e9-4fde-91fd-bc50d8ec56cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095add07-51e9-4fde-91fd-bc50d8ec56cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2081529372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901d32ae-6f70-42a2-9eea-5136ad3b2885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b436588536c4929977ba78d52fad10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:38Z,use_quota=True,user_id='7d12253ddf7a4e1a9aed08cc3bad6ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9800447-2511-40c3-90bc-03b311d011c8),volume_type_id=a9800447-2511-40c3-90bc-03b311d011c8)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7bdc8f-7471-4675-a29c-524708e19e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7bdc8f-7471-4675-a29c-524708e19e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9e7785-4105-47f9-a2a0-4c63de1f065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9e7785-4105-47f9-a2a0-4c63de1f065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901d32ae-6f70-42a2-9eea-5136ad3b2885', 'volume_name': 'volume-901d32ae-6f70-42a2-9eea-5136ad3b2885', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fd8edd-8f30-4d2c-8ed6-a9d0947bbca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fd8edd-8f30-4d2c-8ed6-a9d0947bbca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89993790-fd97-487f-b242-adf104446f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:38 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Volume 901d32ae-6f70-42a2-9eea-5136ad3b2885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901d32ae-6f70-42a2-9eea-5136ad3b2885', 'volume_size': 1}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:38 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642" returned: 0 in 0.716s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2081529372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901d32ae-6f70-42a2-9eea-5136ad3b2885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b436588536c4929977ba78d52fad10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:38Z,use_quota=True,user_id='7d12253ddf7a4e1a9aed08cc3bad6ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9800447-2511-40c3-90bc-03b311d011c8),volume_type_id=a9800447-2511-40c3-90bc-03b311d011c8)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Creating volume 901d32ae-6f70-42a2-9eea-5136ad3b2885 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:38 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1333451-eebd-43a4-b0ed-cb42fdab250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79bcabb-cb3c-4b1b-a992-978bd4534642', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:38 devstack sudo[85406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885 1073741824
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72af6bea-8fc5-42de-af73-a9a04720b7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:38 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:38 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Volume volume-f79bcabb-cb3c-4b1b-a992-978bd4534642 (f79bcabb-cb3c-4b1b-a992-978bd4534642): created successfully
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72af6bea-8fc5-42de-af73-a9a04720b7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Flow 'volume_create_manager' (c12a74c8-9523-4ac5-8366-ad43ed61c399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-badcffff-2b1f-4f95-94a8-603a559ffe35 tempest-ServersNegativeTestJSON-1654549274 None] Created volume successfully.
Apr 16 02:37:38 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949" returned: 0 in 0.652s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:38 devstack sudo[85411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949
Apr 16 02:37:38 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:38 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:38 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.7ae77bab-ce32-4a22-a174-17a70a17d949" returned: 0 in 0.495s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885 1073741824" returned: 0 in 0.713s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-7ae77bab-ce32-4a22-a174-17a70a17d949" released by "_delete_snapshot" :: held 2.650s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" released by "delete_snapshot" :: held 2.676s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:38 devstack sudo[85417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885
Apr 16 02:37:38 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Created reservations ['92f9ec71-a8a9-4b9f-8c78-2b6a3c2ad5ef', '49a13a9a-d3b5-489f-97a3-de5fdceb567e', '55cac8b2-b3c4-40d6-bca2-19133387b353', '8beb3606-6a2f-4213-84fd-04f9b9b21f67'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Delete snapshot completed successfully.
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "cinder-f79bcabb-cb3c-4b1b-a992-978bd4534642-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-568d7ccf-a53d-4b5d-a71b-3b3eac66b9f6 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-7ae77bab-ce32-4a22-a174-17a70a17d949-delete_snapshot" released by "delete_snapshot" :: held 2.840s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-f79bcabb-cb3c-4b1b-a992-978bd4534642-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "cinder-quobyte-f79bcabb-cb3c-4b1b-a992-978bd4534642" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-quobyte-f79bcabb-cb3c-4b1b-a992-978bd4534642" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8df8b25-b795-414b-ad86-81ade0028da4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:39 devstack sudo[85419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642
Apr 16 02:37:39 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:39 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89993790-fd97-487f-b242-adf104446f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901d32ae-6f70-42a2-9eea-5136ad3b2885', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bedf7f4-4fa8-41a6-9d0f-8479ce28e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:39 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Volume volume-901d32ae-6f70-42a2-9eea-5136ad3b2885 (901d32ae-6f70-42a2-9eea-5136ad3b2885): created successfully
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bedf7f4-4fa8-41a6-9d0f-8479ce28e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Flow 'volume_create_manager' (555606b7-96c7-4767-972f-c7ba193fefce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-19a9a990-11a3-4bb0-98a1-3a9344a4b33c tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Created volume successfully.
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Creating offline snapshot 2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7570cbba-8a28-43ea-8346-807630c820cc]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:39 devstack sudo[85424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:39 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:39 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642" returned: 0 in 0.565s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:39 devstack sudo[85427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642
Apr 16 02:37:39 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:40 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.538s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:40 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc 1G
Apr 16 02:37:40 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:40 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f79bcabb-cb3c-4b1b-a992-978bd4534642" returned: 0 in 0.573s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-quobyte-f79bcabb-cb3c-4b1b-a992-978bd4534642" released by "delete_volume" :: held 1.209s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Created reservations ['0c123214-0ff4-4978-ae56-b53cbfd01d0e', 'da5428d6-3b54-4d32-80cb-190869a3ab02', '8936eb83-d73a-4265-9f25-7727dae16dbe', 'd8ca1ec7-6cee-4bd6-aeab-8ba2bca992ce'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:40 devstack sudo[85436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:40 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:40 devstack sudo[85444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:40 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:40 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc 1G" returned: 0 in 0.857s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:40 devstack sudo[85446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc
Apr 16 02:37:40 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:41 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.812s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:41 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Deleted volume successfully.
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "cinder-c05d81f1-b1ed-4393-977d-88e4b7419b81-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-c05d81f1-b1ed-4393-977d-88e4b7419b81-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-36f08f26-d7c9-4bfd-890c-8404031448a7 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-f79bcabb-cb3c-4b1b-a992-978bd4534642-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "cinder-quobyte-c05d81f1-b1ed-4393-977d-88e4b7419b81" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-quobyte-c05d81f1-b1ed-4393-977d-88e4b7419b81" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.790s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:41 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:41 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-28cfae97-91dc-4f65-877f-1f4cbe217435 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Retype volume completed successfully.
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c16333-8397-4077-a54a-251411930c93]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:41 devstack sudo[85451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81
Apr 16 02:37:41 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Acquiring lock "cinder-901d32ae-6f70-42a2-9eea-5136ad3b2885-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "cinder-901d32ae-6f70-42a2-9eea-5136ad3b2885-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Acquiring lock "cinder-quobyte-901d32ae-6f70-42a2-9eea-5136ad3b2885" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "cinder-quobyte-901d32ae-6f70-42a2-9eea-5136ad3b2885" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1889a-6a67-40aa-831e-a1977851ac33]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:42 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" returned: 0 in 1.253s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:42 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc is being set with open permissions: ugo+rw
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:42 devstack sudo[85460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc
Apr 16 02:37:42 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:42 devstack sudo[85459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885
Apr 16 02:37:42 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:42 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81" returned: 0 in 1.142s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:42 devstack cinder-volume[83205]: WARNING py.warnings [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 16 02:37:42 devstack cinder-volume[83205]:   .first()
Apr 16 02:37:42 devstack cinder-volume[83205]: 
Apr 16 02:37:42 devstack sudo[85474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81
Apr 16 02:37:42 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:42 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885" returned: 0 in 0.616s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:42 devstack sudo[85479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885
Apr 16 02:37:42 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:42 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" returned: 0 in 0.737s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.448s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.322s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c3455-c301-46c1-b285-d830d43e5455]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:42 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-9c1ba7cc-1121-4e17-93f0-8863e7a49d2f tempest-SnapshotsActionsTest-389848923 None] Create snapshot completed successfully
Apr 16 02:37:43 devstack sudo[85483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af
Apr 16 02:37:43 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:43 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-c05d81f1-b1ed-4393-977d-88e4b7419b81" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-quobyte-c05d81f1-b1ed-4393-977d-88e4b7419b81" released by "delete_volume" :: held 1.661s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Created reservations ['743971e3-d0e6-4ae0-a34a-cfda42d2a67a', '7be6fb9a-07ad-4b51-a7b2-cac73df255e5', 'bf5e9224-0a57-4028-bfb8-2229bb80aca9', '7a50af81-0517-42fa-bb42-4216b2eca560'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:43 devstack sudo[85486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:43 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:43 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-901d32ae-6f70-42a2-9eea-5136ad3b2885" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "cinder-quobyte-901d32ae-6f70-42a2-9eea-5136ad3b2885" released by "delete_volume" :: held 1.173s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:43 devstack cinder-volume[83205]: WARNING cinder.quota [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:37:43 devstack cinder-volume[83205]: WARNING cinder.quota [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Created reservations ['b2ef6dc7-6461-44e0-b599-b474d25637a4', '691618ba-7671-4ead-bfb3-e26d96b0436d', '2aec2e71-6a82-49f6-bf00-149dafbef34f', '270a9c10-2f7b-4515-9b8a-f39f06adbd26'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:43 devstack sudo[85488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:43 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:43 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af" returned: 0 in 0.590s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.608s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5', 'name': 'volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0cea819-ff3b-4c38-b2b3-d37b38c04c96', 'enforce_multipath': True} {{(pid=83205) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 16 02:37:43 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.588s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Deleted volume successfully.
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-44ef4060-1aca-45d5-a2ae-b798e21f5f00 tempest-ServersNegativeTestJSON-1654549274 None] Lock "cinder-c05d81f1-b1ed-4393-977d-88e4b7419b81-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-ffe8f941-0e91-443f-880f-06cd33c58d7f req-c2989291-a194-4f15-b5a7-5ad032b509ef tempest-DeleteServersTestJSON-1337841203 None] attachment_update completed successfully.
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Deleting offline snapshot 2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] snapshot_file for this snap is: volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[59975e29-afce-4656-93ce-3b5c02d56dca]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:43 devstack sudo[85495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc
Apr 16 02:37:43 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:44 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.693s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:44 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:44 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Deleted volume successfully.
Apr 16 02:37:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-13b1044b-4cc0-4c85-82cb-18e058c079e9 tempest-VolumeRetypeWithoutMigrationTest-913916685 None] Lock "cinder-901d32ae-6f70-42a2-9eea-5136ad3b2885-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:44 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" returned: 0 in 0.558s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:44 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9542e18c-1bba-4499-9f51-9d81377e68ce]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:44 devstack sudo[85562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:44 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:45 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.736s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:45 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:45 devstack sudo[85916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc
Apr 16 02:37:45 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:45 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" returned: 0 in 0.715s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:45 devstack sudo[85924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc
Apr 16 02:37:45 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:46 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" returned: 0 in 0.537s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc" released by "_delete_snapshot" :: held 2.638s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" released by "delete_snapshot" :: held 2.657s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:46 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=148,cinder:INSERT=34,cinder:UPDATE=127,cinder:DELETE=6 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:37:46 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=140,cinder:UPDATE=165,cinder:INSERT=34,cinder:DELETE=7 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:37:46 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Created reservations ['a3e9866e-5696-4e59-83f1-c1d6fbc01180', '2f86ee0b-6bfb-4c63-9ff0-bcc0b098b995', '93c1f796-582a-4d7c-8d57-76925a9c7bd8', 'e5a7b5cf-e017-49c3-8ecb-9367205c1ea6'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:46 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Delete snapshot completed successfully.
Apr 16 02:37:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ba5938bb-7865-461a-9655-3bf7d99bd127 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-2dccf3f9-f8f3-4a16-b0b4-7654530ce0fc-delete_snapshot" released by "delete_snapshot" :: held 2.783s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Creating offline snapshot 791e5185-ef5c-472b-841c-12d71d373a7c of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d89d5-729a-4c6c-8b21-340aa6bab520]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:47 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:47 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:47 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.643s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:47 devstack sudo[85935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c 1G
Apr 16 02:37:47 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:48 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c 1G" returned: 0 in 0.656s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:48 devstack sudo[85940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c
Apr 16 02:37:48 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:49 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c" returned: 0 in 0.569s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:49 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c is being set with open permissions: ugo+rw
Apr 16 02:37:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:49 devstack sudo[85945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c
Apr 16 02:37:49 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:49 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c" returned: 0 in 0.554s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:49 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-17391ae1-ee27-477a-9bb7-12954e9b113b tempest-SnapshotsActionsTest-389848923 None] Create snapshot completed successfully
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-791e5185-ef5c-472b-841c-12d71d373a7c-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-791e5185-ef5c-472b-841c-12d71d373a7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Acquiring lock "cinder-quobyte-791e5185-ef5c-472b-841c-12d71d373a7c" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-791e5185-ef5c-472b-841c-12d71d373a7c" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Deleting offline snapshot 791e5185-ef5c-472b-841c-12d71d373a7c of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] snapshot_file for this snap is: volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f74e72-c8ca-403e-8290-d0e6101563b4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:50 devstack sudo[85979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c
Apr 16 02:37:50 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:51 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c" returned: 0 in 0.733s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:51 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[96469d42-252c-4594-88a3-a2c10862f04b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:51 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:51 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:52 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.738s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:52 devstack sudo[86025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c
Apr 16 02:37:52 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Flow 'volume_create_manager' (f8889a14-a6c6-4288-b1e9-ecd19e457d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a4317e-286a-407b-b30f-5593bfffb237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a4317e-286a-407b-b30f-5593bfffb237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-262346715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38713ff4-6535-4c09-b9d0-52aab01ae20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa930466f8d438080c752278d5f7ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:52Z,use_quota=True,user_id='1b349377786a4a2587b7dc8c21a4758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42655cdc-257c-4733-a30a-aac26744b2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42655cdc-257c-4733-a30a-aac26744b2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a665732-625e-4643-9b48-2fda1bab0c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a665732-625e-4643-9b48-2fda1bab0c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38713ff4-6535-4c09-b9d0-52aab01ae20f', 'volume_name': 'volume-38713ff4-6535-4c09-b9d0-52aab01ae20f', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6402d344-5aa1-4e5f-859a-924ddba414bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6402d344-5aa1-4e5f-859a-924ddba414bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4e8425-26c1-4343-987b-29e54af3b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:52 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Volume 38713ff4-6535-4c09-b9d0-52aab01ae20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38713ff4-6535-4c09-b9d0-52aab01ae20f', 'volume_size': 1}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-262346715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38713ff4-6535-4c09-b9d0-52aab01ae20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa930466f8d438080c752278d5f7ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:52Z,use_quota=True,user_id='1b349377786a4a2587b7dc8c21a4758f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Creating volume 38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:52 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:52 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f 1073741824
Apr 16 02:37:52 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:52 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c" returned: 0 in 0.610s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:52 devstack sudo[86033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c
Apr 16 02:37:52 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-41db20d5-c006-4d40-830b-4f72cacf09fb req-503bd8fc-ed9f-4cb4-ac99-099168f360f5 tempest-DeleteServersTestJSON-1337841203 None] Terminate volume connection completed successfully.
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-41db20d5-c006-4d40-830b-4f72cacf09fb req-503bd8fc-ed9f-4cb4-ac99-099168f360f5 tempest-DeleteServersTestJSON-1337841203 None] Deleting attachment e0cea819-ff3b-4c38-b2b3-d37b38c04c96. {{(pid=83205) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 16 02:37:53 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f 1073741824" returned: 0 in 0.598s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:53 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f
Apr 16 02:37:53 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:53 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.791e5185-ef5c-472b-841c-12d71d373a7c" returned: 0 in 0.527s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-791e5185-ef5c-472b-841c-12d71d373a7c" released by "_delete_snapshot" :: held 2.675s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" released by "delete_snapshot" :: held 2.712s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Created reservations ['961a3340-0400-4dce-bf67-9086ad91bb4d', '280e9f98-57e6-45b4-98ea-dba838e2feea', 'b6c594e1-2cfd-4180-bd69-18dcf425a52f', '44659b72-e389-415a-a1d4-e28244334837'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Delete snapshot completed successfully.
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbb62dec-a7cd-47c0-91d5-2108f4b30a96 tempest-SnapshotsActionsTest-403963739 None] Lock "cinder-791e5185-ef5c-472b-841c-12d71d373a7c-delete_snapshot" released by "delete_snapshot" :: held 2.833s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:53 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f" returned: 0 in 0.484s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4e8425-26c1-4343-987b-29e54af3b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38713ff4-6535-4c09-b9d0-52aab01ae20f', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cf4504-fb03-4f90-b75e-0d82b85f09b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:53 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Volume volume-38713ff4-6535-4c09-b9d0-52aab01ae20f (38713ff4-6535-4c09-b9d0-52aab01ae20f): created successfully
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cf4504-fb03-4f90-b75e-0d82b85f09b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Flow 'volume_create_manager' (f8889a14-a6c6-4288-b1e9-ecd19e457d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-79026100-dec4-4154-89ee-013d9f1d4fdc tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Created volume successfully.
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "cinder-123ceb5b-dc2f-426e-8c09-66bc808ca33f-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-123ceb5b-dc2f-426e-8c09-66bc808ca33f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "cinder-quobyte-123ceb5b-dc2f-426e-8c09-66bc808ca33f" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-quobyte-123ceb5b-dc2f-426e-8c09-66bc808ca33f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Deleting offline snapshot 123ceb5b-dc2f-426e-8c09-66bc808ca33f of volume 23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] snapshot_file for this snap is: volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a5c55-da75-4576-bd30-012b4425b935]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:54 devstack sudo[86043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:54 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Creating offline snapshot c296fa8f-66e7-4a84-b2ac-437c60d7979e of volume 38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[987edcd3-573f-422d-88af-322e2259c50b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:54 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.653s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be7b4bf-a853-47ed-83c8-ceaaafbc9187]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:54 devstack sudo[86049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f
Apr 16 02:37:54 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:54 devstack sudo[86050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd
Apr 16 02:37:54 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:55 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f" returned: 0 in 0.562s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:55 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e 1G
Apr 16 02:37:55 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:55 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" returned: 0 in 0.554s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:55 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:55 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:55 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e 1G" returned: 0 in 0.578s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38713ff4-6535-4c09-b9d0-52aab01ae20f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:55 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38713ff4-6535-4c09-b9d0-52aab01ae20f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e
Apr 16 02:37:55 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Flow 'volume_create_manager' (2bed9af7-1a2a-43ee-8ffd-d1a8156dc84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323e4dfa-8b9f-46f9-971d-a032f5849809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323e4dfa-8b9f-46f9-971d-a032f5849809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1006851613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e420fe16-10b4-420e-85ce-0abf3db6d786,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e72068a30b8f4ac7a34291921d9cb054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:56Z,use_quota=True,user_id='c5847660deeb4156929aa22be16384bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d53d5ed-2516-4a0c-b106-c49030897e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d53d5ed-2516-4a0c-b106-c49030897e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce93229-ddfe-4dd6-ae23-55cf44cc1c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce93229-ddfe-4dd6-ae23-55cf44cc1c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e420fe16-10b4-420e-85ce-0abf3db6d786', 'volume_name': 'volume-e420fe16-10b4-420e-85ce-0abf3db6d786', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:55 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f66049-6164-4f0c-8b9b-2010b69e7d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f66049-6164-4f0c-8b9b-2010b69e7d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3a6135-734a-4e20-9862-bf26f8088d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:55 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Volume e420fe16-10b4-420e-85ce-0abf3db6d786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e420fe16-10b4-420e-85ce-0abf3db6d786', 'volume_size': 1}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.583s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:55 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f
Apr 16 02:37:55 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:56 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38713ff4-6535-4c09-b9d0-52aab01ae20f -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e" returned: 0 in 0.423s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:56 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e is being set with open permissions: ugo+rw
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:56 devstack sudo[86077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e
Apr 16 02:37:56 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:56 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd.123ceb5b-dc2f-426e-8c09-66bc808ca33f" returned: 0 in 0.419s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-quobyte-123ceb5b-dc2f-426e-8c09-66bc808ca33f" released by "_delete_snapshot" :: held 2.271s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" released by "delete_snapshot" :: held 2.287s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Created reservations ['8860022c-41c8-49eb-8665-f5cb8927ecf9', '3770cc66-42f4-4d5d-9c32-641bfc721de6', '0c33ad6d-cb80-42ba-8c79-a1626412dcc2', '56c90904-e67e-49c5-89cb-a99851950926'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:56 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Delete snapshot completed successfully.
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4eda1fd-5981-48fc-a97c-80bcba3bfd5e tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-123ceb5b-dc2f-426e-8c09-66bc808ca33f-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:56 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e" returned: 0 in 0.435s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:56 devstack sudo[86080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.info
Apr 16 02:37:56 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Acquiring lock "cinder-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Lock "cinder-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Acquiring lock "cinder-quobyte-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Lock "cinder-quobyte-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a5ae53-7ddd-48a9-bb2f-4f7a1fff284b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:56 devstack sudo[86082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af
Apr 16 02:37:56 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:57 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.info" returned: 0 in 0.420s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:57 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.info is being set with open permissions: ugo+rw
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:57 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.info
Apr 16 02:37:57 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "cinder-23245e7d-28ac-4b4f-a73f-4d34f3c719cd-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-23245e7d-28ac-4b4f-a73f-4d34f3c719cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:57 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af" returned: 0 in 0.518s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6dd0a0-3f97-46c1-86b6-c89682149d0f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:57 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af
Apr 16 02:37:57 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:57 devstack sudo[86092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd
Apr 16 02:37:57 devstack sudo[86092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:57 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.info" returned: 0 in 0.431s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.904s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1006851613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e420fe16-10b4-420e-85ce-0abf3db6d786,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e72068a30b8f4ac7a34291921d9cb054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:56Z,use_quota=True,user_id='c5847660deeb4156929aa22be16384bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Creating volume e420fe16-10b4-420e-85ce-0abf3db6d786 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:57 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:57 devstack sudo[86096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786 1073741824
Apr 16 02:37:57 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:57 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-53e0d43f-9426-4e1b-b66c-ee7aa2cf44e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Create snapshot completed successfully
Apr 16 02:37:57 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Lock "cinder-quobyte-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af" released by "delete_volume" :: held 1.024s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:57 devstack sudo[86092]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" returned: 0 in 0.512s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Created reservations ['4e34d229-49c8-40e4-8be1-9545266cf0c2', 'ce13f823-9882-4e6e-b1ac-9b98b5541d74', '9732eb4f-8429-442e-87ce-4555c566b1f8', 'c2d2bc69-18b3-4bd8-bcc0-8679b55aca18'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:57 devstack sudo[86102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd
Apr 16 02:37:57 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:57 devstack sudo[86104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:57 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:58 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786 1073741824" returned: 0 in 0.521s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "cinder-c296fa8f-66e7-4a84-b2ac-437c60d7979e-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:58 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786
Apr 16 02:37:58 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-c296fa8f-66e7-4a84-b2ac-437c60d7979e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "cinder-quobyte-38713ff4-6535-4c09-b9d0-52aab01ae20f" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-quobyte-38713ff4-6535-4c09-b9d0-52aab01ae20f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "cinder-quobyte-c296fa8f-66e7-4a84-b2ac-437c60d7979e" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-quobyte-c296fa8f-66e7-4a84-b2ac-437c60d7979e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Deleting offline snapshot c296fa8f-66e7-4a84-b2ac-437c60d7979e of volume 38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] snapshot_file for this snap is: volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ef6e5c-6258-433f-bd15-7be72cd872f7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:58 devstack sudo[86111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e
Apr 16 02:37:58 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:58 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Deleted volume successfully.
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b8117e7-56fe-4100-806a-677926d69648 tempest-DeleteServersTestJSON-1337841203 None] Lock "cinder-b4204ea4-f3f6-40b2-8188-9f9ba6dac8af-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:58 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" returned: 0 in 0.632s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-quobyte-23245e7d-28ac-4b4f-a73f-4d34f3c719cd" released by "delete_volume" :: held 1.177s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Created reservations ['1988d03e-df50-4619-b3ed-e35df0e4805c', '54c92489-45c6-451d-ac65-b3dc47843a4b', 'b0dfd8ae-d1c5-499e-b732-d674debcf8f2', '95daab27-2136-4e2f-8d62-a5b613e0cba9'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:58 devstack sudo[86116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:58 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:58 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786" returned: 0 in 0.534s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3a6135-734a-4e20-9862-bf26f8088d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e420fe16-10b4-420e-85ce-0abf3db6d786', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41823d6-ea82-4856-84fc-e43dee6c4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:58 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Volume volume-e420fe16-10b4-420e-85ce-0abf3db6d786 (e420fe16-10b4-420e-85ce-0abf3db6d786): created successfully
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41823d6-ea82-4856-84fc-e43dee6c4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Flow 'volume_create_manager' (2bed9af7-1a2a-43ee-8ffd-d1a8156dc84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-cecc2896-7898-4598-a57c-d5cd8d27e61f tempest-VolumesTestJSON-461642325 None] Created volume successfully.
Apr 16 02:37:58 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e" returned: 0 in 0.515s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38713ff4-6535-4c09-b9d0-52aab01ae20f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[37864236-23a2-4e05-ac88-753945e095ca]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:37:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:58 devstack sudo[86121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f
Apr 16 02:37:58 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:59 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:37:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Deleted volume successfully.
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8180ad9a-e7e9-4492-8635-e7a66f68a94d tempest-SnapshotsActionsTest-389848923 None] Lock "cinder-23245e7d-28ac-4b4f-a73f-4d34f3c719cd-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:37:59 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Flow 'volume_create_manager' (c6070cf6-47a3-4ddb-8f03-412b8c1c329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d09e10-18fa-4a44-a4e3-30c115e3b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d09e10-18fa-4a44-a4e3-30c115e3b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-244458149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab9a940-87dc-40e7-91ac-b1cedb299ab2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e72068a30b8f4ac7a34291921d9cb054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:59Z,use_quota=True,user_id='c5847660deeb4156929aa22be16384bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc45394-e327-420a-a716-e8b2e3ef28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc45394-e327-420a-a716-e8b2e3ef28d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcab47d-9116-48fa-a4e0-97635f09597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcab47d-9116-48fa-a4e0-97635f09597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab9a940-87dc-40e7-91ac-b1cedb299ab2', 'volume_name': 'volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ffcfed-4387-4dd8-8853-75aaf09fa4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ffcfed-4387-4dd8-8853-75aaf09fa4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3931cd43-90fd-4f2d-b7b5-b149b3bfa5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:37:59 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Volume 0ab9a940-87dc-40e7-91ac-b1cedb299ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2', 'volume_size': 1}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-244458149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab9a940-87dc-40e7-91ac-b1cedb299ab2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e72068a30b8f4ac7a34291921d9cb054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:37:59Z,use_quota=True,user_id='c5847660deeb4156929aa22be16384bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Creating volume 0ab9a940-87dc-40e7-91ac-b1cedb299ab2 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:37:59 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f" returned: 0 in 0.694s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:59 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2 1073741824
Apr 16 02:37:59 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:59 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e
Apr 16 02:37:59 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:37:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:37:59 devstack sudo[86138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:37:59 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:00 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e" returned: 0 in 0.566s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:00 devstack sudo[86140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e
Apr 16 02:38:00 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:00 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2 1073741824" returned: 0 in 0.661s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:00 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2
Apr 16 02:38:00 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:00 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.531s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:00 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f.c296fa8f-66e7-4a84-b2ac-437c60d7979e" returned: 0 in 0.809s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-quobyte-c296fa8f-66e7-4a84-b2ac-437c60d7979e" released by "_delete_snapshot" :: held 2.656s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-quobyte-38713ff4-6535-4c09-b9d0-52aab01ae20f" released by "delete_snapshot" :: held 2.671s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Created reservations ['43c40aea-4874-4ef4-b744-d9ffd153b242', 'f3620a31-c7cd-4e43-8304-88b555d4a2d7', '857720c9-92f7-4950-b189-ce1b4b08f18a', 'a07df961-7256-4628-9f58-524585056918'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Delete snapshot completed successfully.
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03b1f1b0-d0b1-4d0d-b0c8-3a8409002b6d tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-c296fa8f-66e7-4a84-b2ac-437c60d7979e-delete_snapshot" released by "delete_snapshot" :: held 2.777s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:00 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2" returned: 0 in 0.859s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3931cd43-90fd-4f2d-b7b5-b149b3bfa5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1753f1-d7b3-4aef-b370-e1c694412019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:01 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Volume volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2 (0ab9a940-87dc-40e7-91ac-b1cedb299ab2): created successfully
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1753f1-d7b3-4aef-b370-e1c694412019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Flow 'volume_create_manager' (c6070cf6-47a3-4ddb-8f03-412b8c1c329f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:01 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ec2b2fb5-499f-4145-b3bf-5a7880676615 tempest-VolumesTestJSON-461642325 None] Created volume successfully.
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "cinder-38713ff4-6535-4c09-b9d0-52aab01ae20f-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-38713ff4-6535-4c09-b9d0-52aab01ae20f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "cinder-quobyte-38713ff4-6535-4c09-b9d0-52aab01ae20f" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-quobyte-38713ff4-6535-4c09-b9d0-52aab01ae20f" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3331205-0e24-4391-b108-440dcb4a9516]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:01 devstack sudo[86183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f
Apr 16 02:38:01 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Flow 'volume_create_manager' (b998e702-3b32-4745-baec-8e648b1414c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c181bb6-66fb-4e6d-8b4a-a446d4ed9737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c181bb6-66fb-4e6d-8b4a-a446d4ed9737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172045197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f48311-33c7-418d-b597-a1b83f0c3aee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e72068a30b8f4ac7a34291921d9cb054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:02Z,use_quota=True,user_id='c5847660deeb4156929aa22be16384bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d616d68-daeb-4085-8697-bac79f7adf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d616d68-daeb-4085-8697-bac79f7adf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e0cd35-b3b3-412a-9195-6e6381315f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e0cd35-b3b3-412a-9195-6e6381315f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f48311-33c7-418d-b597-a1b83f0c3aee', 'volume_name': 'volume-24f48311-33c7-418d-b597-a1b83f0c3aee', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c94ccf7-d4db-40ab-bfc9-5a790588c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c94ccf7-d4db-40ab-bfc9-5a790588c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e5e2d7-2f9c-4faa-8ed1-1539d21701cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:02 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Volume 24f48311-33c7-418d-b597-a1b83f0c3aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f48311-33c7-418d-b597-a1b83f0c3aee', 'volume_size': 1}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172045197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f48311-33c7-418d-b597-a1b83f0c3aee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e72068a30b8f4ac7a34291921d9cb054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:02Z,use_quota=True,user_id='c5847660deeb4156929aa22be16384bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Creating volume 24f48311-33c7-418d-b597-a1b83f0c3aee {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:02 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:02 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f" returned: 0 in 0.616s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:02 devstack sudo[86188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee 1073741824
Apr 16 02:38:02 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:02 devstack sudo[86190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f
Apr 16 02:38:02 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:02 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee 1073741824" returned: 0 in 0.574s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:02 devstack sudo[86197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee
Apr 16 02:38:02 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:02 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-38713ff4-6535-4c09-b9d0-52aab01ae20f" returned: 0 in 0.589s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-quobyte-38713ff4-6535-4c09-b9d0-52aab01ae20f" released by "delete_volume" :: held 1.270s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Created reservations ['eb389349-e6a7-483a-a024-d946ba5a07c7', '67ffd0e4-6524-4e48-8c6a-5a23a6471678', '884f4aec-3330-489a-9f06-7b0356dc0c92', 'af3b15d6-bac7-4f96-bf1b-bce9f978b9de'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:02 devstack sudo[86199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:02 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:03 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee" returned: 0 in 0.569s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e5e2d7-2f9c-4faa-8ed1-1539d21701cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f48311-33c7-418d-b597-a1b83f0c3aee', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f8b630-e9a4-43ca-bb87-a774232e7993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:03 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Volume volume-24f48311-33c7-418d-b597-a1b83f0c3aee (24f48311-33c7-418d-b597-a1b83f0c3aee): created successfully
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f8b630-e9a4-43ca-bb87-a774232e7993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Flow 'volume_create_manager' (b998e702-3b32-4745-baec-8e648b1414c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-5eed0b52-649f-4788-8f71-801fee6ecf5f tempest-VolumesTestJSON-461642325 None] Created volume successfully.
Apr 16 02:38:03 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.606s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Deleted volume successfully.
Apr 16 02:38:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ad1676f-ec3a-4a26-b2c0-872387eda1ec tempest-VolumeSnapshotQuotasNegativeTestJSON-2018585368 None] Lock "cinder-38713ff4-6535-4c09-b9d0-52aab01ae20f-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Acquiring lock "cinder-24f48311-33c7-418d-b597-a1b83f0c3aee-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Lock "cinder-24f48311-33c7-418d-b597-a1b83f0c3aee-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Acquiring lock "cinder-quobyte-24f48311-33c7-418d-b597-a1b83f0c3aee" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Lock "cinder-quobyte-24f48311-33c7-418d-b597-a1b83f0c3aee" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:04 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1297a2d-9683-4f31-bc3f-84c4ce4b09f5]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:05 devstack sudo[86204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee
Apr 16 02:38:05 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:05 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee" returned: 0 in 0.582s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:05 devstack sudo[86209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee
Apr 16 02:38:05 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:06 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-24f48311-33c7-418d-b597-a1b83f0c3aee" returned: 0 in 0.593s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Lock "cinder-quobyte-24f48311-33c7-418d-b597-a1b83f0c3aee" released by "delete_volume" :: held 1.209s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Created reservations ['fc920009-2092-4ea0-825e-60823b04360f', 'f3b83f1a-bb84-4882-9c03-753b85751126', 'df6bab3f-e92b-4d2c-8502-62bfdac78c96', 'a2a6a1fa-6715-4f75-80bf-f78fdd44dbd1'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:06 devstack sudo[86212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:06 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:06 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.608s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Deleted volume successfully.
Apr 16 02:38:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-598c26ca-a945-4ab5-bd18-456854297272 tempest-VolumesTestJSON-461642325 None] Lock "cinder-24f48311-33c7-418d-b597-a1b83f0c3aee-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Acquiring lock "cinder-0ab9a940-87dc-40e7-91ac-b1cedb299ab2-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Lock "cinder-0ab9a940-87dc-40e7-91ac-b1cedb299ab2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Acquiring lock "cinder-quobyte-0ab9a940-87dc-40e7-91ac-b1cedb299ab2" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Lock "cinder-quobyte-0ab9a940-87dc-40e7-91ac-b1cedb299ab2" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd99f9-175e-48b9-9d66-108378b82ea1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:07 devstack sudo[86215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2
Apr 16 02:38:07 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:07 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2" returned: 0 in 0.633s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:07 devstack sudo[86220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2
Apr 16 02:38:07 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:08 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0ab9a940-87dc-40e7-91ac-b1cedb299ab2" returned: 0 in 0.616s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Lock "cinder-quobyte-0ab9a940-87dc-40e7-91ac-b1cedb299ab2" released by "delete_volume" :: held 1.277s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Created reservations ['3b16bd58-9e3d-452d-907b-696d8b8fe5c5', 'e3463383-2066-4756-bacb-237efb6984e5', '317f979b-bd07-4548-b11d-d4f18f9c05de', '77d711ec-6e26-46a6-a660-fbda428a3602'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:08 devstack sudo[86223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:08 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:09 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.708s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Deleted volume successfully.
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80273c77-15fc-4204-9257-a0fb59b57630 tempest-VolumesTestJSON-461642325 None] Lock "cinder-0ab9a940-87dc-40e7-91ac-b1cedb299ab2-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Acquiring lock "cinder-e420fe16-10b4-420e-85ce-0abf3db6d786-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Lock "cinder-e420fe16-10b4-420e-85ce-0abf3db6d786-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Acquiring lock "cinder-quobyte-e420fe16-10b4-420e-85ce-0abf3db6d786" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Lock "cinder-quobyte-e420fe16-10b4-420e-85ce-0abf3db6d786" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3d864c-67bb-4a55-84da-f903bf456251]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:09 devstack sudo[86226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786
Apr 16 02:38:09 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Flow 'volume_create_manager' (845ff5be-3da2-4281-829d-c7075139e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbf5950-498d-43ca-b951-3a8c58046f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbf5950-498d-43ca-b951-3a8c58046f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2136035603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b370cd-4a52-43e9-8278-4208a5e335c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574911bae0c64b70830eb5483d9044bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:10Z,use_quota=True,user_id='097fc3438bba450e803fea169f80f8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8c6056a-cc59-490e-8888-1b2168ebdc15),volume_type_id=d8c6056a-cc59-490e-8888-1b2168ebdc15)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c629e4-2ab8-46c3-9323-80116018ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c629e4-2ab8-46c3-9323-80116018ff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec3f4a9-86cb-41c1-8e57-7063c526c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec3f4a9-86cb-41c1-8e57-7063c526c3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b370cd-4a52-43e9-8278-4208a5e335c0', 'volume_name': 'volume-f2b370cd-4a52-43e9-8278-4208a5e335c0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5410d5-17b5-4b59-b2a6-cc75d1c527bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5410d5-17b5-4b59-b2a6-cc75d1c527bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5662c367-7cc1-452b-a697-843807d72de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:09 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Volume f2b370cd-4a52-43e9-8278-4208a5e335c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b370cd-4a52-43e9-8278-4208a5e335c0', 'volume_size': 1}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2136035603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b370cd-4a52-43e9-8278-4208a5e335c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574911bae0c64b70830eb5483d9044bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:10Z,use_quota=True,user_id='097fc3438bba450e803fea169f80f8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8c6056a-cc59-490e-8888-1b2168ebdc15),volume_type_id=d8c6056a-cc59-490e-8888-1b2168ebdc15)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Creating volume f2b370cd-4a52-43e9-8278-4208a5e335c0 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:09 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:09 devstack sudo[86228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0 1073741824
Apr 16 02:38:09 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:10 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786" returned: 0 in 0.654s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:10 devstack sudo[86233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786
Apr 16 02:38:10 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:10 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0 1073741824" returned: 0 in 0.649s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:10 devstack sudo[86239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0
Apr 16 02:38:10 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:10 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e420fe16-10b4-420e-85ce-0abf3db6d786" returned: 0 in 0.554s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Lock "cinder-quobyte-e420fe16-10b4-420e-85ce-0abf3db6d786" released by "delete_volume" :: held 1.251s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Created reservations ['93e82c21-236f-4517-b5d9-95be78816fa9', '3fe51094-43c5-4ad9-b3bc-a9e846076d20', 'f5190ea6-a65d-4a20-9d49-194ab6388fb7', 'eca36f73-5cd6-4414-b05e-0562bf9fa1f1'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:10 devstack sudo[86242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:10 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:11 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0" returned: 0 in 0.556s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5662c367-7cc1-452b-a697-843807d72de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b370cd-4a52-43e9-8278-4208a5e335c0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4015be4-81b2-4146-b19e-61aa65dc38db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Volume volume-f2b370cd-4a52-43e9-8278-4208a5e335c0 (f2b370cd-4a52-43e9-8278-4208a5e335c0): created successfully
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4015be4-81b2-4146-b19e-61aa65dc38db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Flow 'volume_create_manager' (845ff5be-3da2-4281-829d-c7075139e49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:11 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-81fc86c3-b2c5-443f-9ad4-72ed101ad254 tempest-VolumeTypesAccessTest-1421557152 None] Created volume successfully.
Apr 16 02:38:11 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.625s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:11 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Deleted volume successfully.
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-db2a58d9-09f9-4787-9d9e-4d595bdd9a21 tempest-VolumesTestJSON-461642325 None] Lock "cinder-e420fe16-10b4-420e-85ce-0abf3db6d786-delete_volume" released by "delete_volume" :: held 2.028s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Acquiring lock "cinder-f2b370cd-4a52-43e9-8278-4208a5e335c0-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Lock "cinder-f2b370cd-4a52-43e9-8278-4208a5e335c0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Acquiring lock "cinder-quobyte-f2b370cd-4a52-43e9-8278-4208a5e335c0" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Lock "cinder-quobyte-f2b370cd-4a52-43e9-8278-4208a5e335c0" acquired by "delete_volume" :: waited 0.022s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[72538564-c370-48f1-a7a9-6fd0d8a6c5bb]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:12 devstack sudo[86246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0
Apr 16 02:38:12 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:12 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0" returned: 0 in 0.825s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:12 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0
Apr 16 02:38:12 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:13 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2b370cd-4a52-43e9-8278-4208a5e335c0" returned: 0 in 0.583s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Lock "cinder-quobyte-f2b370cd-4a52-43e9-8278-4208a5e335c0" released by "delete_volume" :: held 1.435s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:13 devstack cinder-volume[83205]: WARNING cinder.quota [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-832150340 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-832150340, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:38:13 devstack cinder-volume[83205]: WARNING cinder.quota [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-832150340 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-832150340, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Created reservations ['d92ae8f1-027a-4a68-9cc5-47e341b9d34a', '94f696df-40f5-406b-9364-b2f15ada7a50', '2ad626ec-2293-4d27-b0d5-ec0aa8696a03', '1c7a72d3-1e64-486e-b540-20b787787a31'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:13 devstack sudo[86254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:13 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:13 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.538s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:13 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Deleted volume successfully.
Apr 16 02:38:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9ded5e20-f115-4b27-be34-8169daee7d85 tempest-VolumeTypesAccessTest-1421557152 None] Lock "cinder-f2b370cd-4a52-43e9-8278-4208a5e335c0-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Flow 'volume_create_manager' (6baece9b-c36f-499b-8eb2-8a5469a610fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee03fc0-dbc9-4ec6-aff5-effc1fde1316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee03fc0-dbc9-4ec6-aff5-effc1fde1316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1217055743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a35c3-4b55-4efa-a0ad-926c31795bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1450e25d222840ae8c3b93993ce73354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:19Z,use_quota=True,user_id='0ada3e7043e14918ac5097d2f0abd431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b94937-8206-4937-b353-21b74463cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b94937-8206-4937-b353-21b74463cc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01d1250-3c58-4f30-8472-8adc11a9ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01d1250-3c58-4f30-8472-8adc11a9ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2a35c3-4b55-4efa-a0ad-926c31795bfc', 'volume_name': 'volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0864d257-e14a-4a0c-a893-0dd4bc603fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0864d257-e14a-4a0c-a893-0dd4bc603fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0942d6e-a40b-4ec0-a18c-7f7a910177e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:19 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Volume fd2a35c3-4b55-4efa-a0ad-926c31795bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc', 'volume_size': 1}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1217055743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a35c3-4b55-4efa-a0ad-926c31795bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1450e25d222840ae8c3b93993ce73354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:19Z,use_quota=True,user_id='0ada3e7043e14918ac5097d2f0abd431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Creating volume fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:19 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:19 devstack sudo[86264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc 1073741824
Apr 16 02:38:19 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:20 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc 1073741824" returned: 0 in 0.686s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:20 devstack sudo[86269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc
Apr 16 02:38:20 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:20 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" returned: 0 in 0.770s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0942d6e-a40b-4ec0-a18c-7f7a910177e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a49295-b21f-4aa7-9d89-38700eaa7eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:20 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Volume volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc (fd2a35c3-4b55-4efa-a0ad-926c31795bfc): created successfully
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a49295-b21f-4aa7-9d89-38700eaa7eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Flow 'volume_create_manager' (6baece9b-c36f-499b-8eb2-8a5469a610fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:20 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-6b707505-c3f9-47ac-a16d-3488ed1a9090 tempest-VolumesDeleteCascade-680569093 None] Created volume successfully.
Apr 16 02:38:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Creating offline snapshot 50b96b8e-5da9-49f2-ab5c-d90454c96d58 of volume fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:38:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c4b123-acce-4a33-b405-ff26294cf43c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:21 devstack sudo[86272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc
Apr 16 02:38:21 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:22 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" returned: 0 in 0.600s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:22 devstack sudo[86281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 1G
Apr 16 02:38:22 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:22 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 1G" returned: 0 in 0.592s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:22 devstack sudo[86299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58
Apr 16 02:38:22 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:23 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58" returned: 0 in 0.549s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:23 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 is being set with open permissions: ugo+rw
Apr 16 02:38:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:23 devstack sudo[86304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58
Apr 16 02:38:23 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:24 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58" returned: 0 in 0.630s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:24 devstack sudo[86307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.info
Apr 16 02:38:24 devstack sudo[86307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:24 devstack sudo[86307]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.info" returned: 0 in 0.613s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:24 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.info is being set with open permissions: ugo+rw
Apr 16 02:38:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:24 devstack sudo[86311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.info
Apr 16 02:38:24 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:25 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.info" returned: 0 in 0.611s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.663s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-5751af40-319c-4b62-ab4c-56a731377777 tempest-VolumesDeleteCascade-680569093 None] Create snapshot completed successfully
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Creating offline snapshot 168350d4-f3d2-452a-a0ed-c135cb8d8bfe of volume fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc22b4-6b05-4534-b42c-65e8e8fec26e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:26 devstack sudo[86315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58
Apr 16 02:38:26 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:26 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58" returned: 0 in 0.762s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:38:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:26 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe 1G
Apr 16 02:38:26 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:27 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe 1G" returned: 0 in 0.731s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:27 devstack sudo[86328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe
Apr 16 02:38:27 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:28 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe" returned: 0 in 0.581s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:28 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe is being set with open permissions: ugo+rw
Apr 16 02:38:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:28 devstack sudo[86333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe
Apr 16 02:38:28 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:28 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe" returned: 0 in 0.717s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:29 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b617046e-3cd7-4b9b-8aa8-264243e942cc tempest-VolumesDeleteCascade-680569093 None] Create snapshot completed successfully
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-fd2a35c3-4b55-4efa-a0ad-926c31795bfc-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-fd2a35c3-4b55-4efa-a0ad-926c31795bfc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Performing cascade delete. {{(pid=83205) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-168350d4-f3d2-452a-a0ed-c135cb8d8bfe-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-168350d4-f3d2-452a-a0ed-c135cb8d8bfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-168350d4-f3d2-452a-a0ed-c135cb8d8bfe" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-168350d4-f3d2-452a-a0ed-c135cb8d8bfe" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Deleting offline snapshot 168350d4-f3d2-452a-a0ed-c135cb8d8bfe of volume fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] snapshot_file for this snap is: volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[114aa8d1-8410-4f29-8685-956ca5e29ac3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:29 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe
Apr 16 02:38:29 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:30 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe" returned: 0 in 0.811s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:38:30 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddb7407-9e27-4619-875f-6a7187c5ec8b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:30 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58
Apr 16 02:38:30 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:31 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58" returned: 0 in 0.710s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:31 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe
Apr 16 02:38:31 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Flow 'volume_create_manager' (af4d9c0a-9051-4738-9e0b-4b7da269df28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d93293-8c87-4949-a91e-bf222f4457dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d93293-8c87-4949-a91e-bf222f4457dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-164414243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12669121-1525-4dbe-acfa-73b52fb55021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0413ad06ffe043d49567c55923d20a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:31Z,use_quota=True,user_id='a5d458b3c1cb40ca88e238c9c3f665bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c17d54-54d9-4ea2-87a5-7f76553c376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c17d54-54d9-4ea2-87a5-7f76553c376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bba07b-2053-490b-9b97-67a03bf6e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bba07b-2053-490b-9b97-67a03bf6e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12669121-1525-4dbe-acfa-73b52fb55021', 'volume_name': 'volume-12669121-1525-4dbe-acfa-73b52fb55021', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1378d318-f154-4c80-9cc1-2a96a3aa4a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1378d318-f154-4c80-9cc1-2a96a3aa4a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ecb2aa-052f-4be9-83f6-76dfbaa61872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:31 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Volume 12669121-1525-4dbe-acfa-73b52fb55021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12669121-1525-4dbe-acfa-73b52fb55021', 'volume_size': 1}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-164414243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12669121-1525-4dbe-acfa-73b52fb55021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0413ad06ffe043d49567c55923d20a6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:31Z,use_quota=True,user_id='a5d458b3c1cb40ca88e238c9c3f665bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Creating volume 12669121-1525-4dbe-acfa-73b52fb55021 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:31 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:31 devstack sudo[86378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021 1073741824
Apr 16 02:38:31 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:31 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe" returned: 0 in 0.711s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:31 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021 1073741824" returned: 0 in 0.652s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:31 devstack sudo[86386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe
Apr 16 02:38:31 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:31 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021
Apr 16 02:38:31 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:32 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021" returned: 0 in 0.579s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ecb2aa-052f-4be9-83f6-76dfbaa61872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12669121-1525-4dbe-acfa-73b52fb55021', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f00ff39-4e4b-4a7e-a64b-1b263503fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:32 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Volume volume-12669121-1525-4dbe-acfa-73b52fb55021 (12669121-1525-4dbe-acfa-73b52fb55021): created successfully
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f00ff39-4e4b-4a7e-a64b-1b263503fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Flow 'volume_create_manager' (af4d9c0a-9051-4738-9e0b-4b7da269df28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:32 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-47ebbad5-895e-4913-a6e0-c0d44fc8158f tempest-VolumeQuotasNegativeTestJSON-168925765 None] Created volume successfully.
Apr 16 02:38:32 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.168350d4-f3d2-452a-a0ed-c135cb8d8bfe" returned: 0 in 0.778s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-168350d4-f3d2-452a-a0ed-c135cb8d8bfe" released by "_delete_snapshot" :: held 3.124s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" released by "delete_snapshot" :: held 3.152s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Created reservations ['4ebc3ec5-7dcd-4687-9422-75316ad38fd9', '3d1777de-f915-4325-b21d-32cd1081ab24', '8acb560e-542f-43ae-adea-b97073039e9c', 'adab6b65-77ea-4348-98f9-427f6ad98851'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:32 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Delete snapshot completed successfully.
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-168350d4-f3d2-452a-a0ed-c135cb8d8bfe-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-50b96b8e-5da9-49f2-ab5c-d90454c96d58-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-50b96b8e-5da9-49f2-ab5c-d90454c96d58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-50b96b8e-5da9-49f2-ab5c-d90454c96d58" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-50b96b8e-5da9-49f2-ab5c-d90454c96d58" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Deleting offline snapshot 50b96b8e-5da9-49f2-ab5c-d90454c96d58 of volume fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] snapshot_file for this snap is: volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[58342bfa-d173-4f1d-a94c-9da43e0e8524]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:32 devstack sudo[86394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58
Apr 16 02:38:32 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:33 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58" returned: 0 in 0.794s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:38:33 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb094cd-8ec4-4bd1-8f2d-36352d57a002]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:33 devstack sudo[86399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc
Apr 16 02:38:33 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Acquiring lock "cinder-12669121-1525-4dbe-acfa-73b52fb55021-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "cinder-12669121-1525-4dbe-acfa-73b52fb55021-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Acquiring lock "cinder-quobyte-12669121-1525-4dbe-acfa-73b52fb55021" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "cinder-quobyte-12669121-1525-4dbe-acfa-73b52fb55021" acquired by "delete_volume" :: waited 0.028s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a6e98-9e29-4da4-966d-dcc1faa4c54e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:34 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021
Apr 16 02:38:34 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:34 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" returned: 0 in 1.011s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:34 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58
Apr 16 02:38:34 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:35 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021" returned: 0 in 0.939s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:35 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021
Apr 16 02:38:35 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:35 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58" returned: 0 in 0.846s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:35 devstack sudo[86420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58
Apr 16 02:38:35 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:36 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12669121-1525-4dbe-acfa-73b52fb55021" returned: 0 in 0.659s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "cinder-quobyte-12669121-1525-4dbe-acfa-73b52fb55021" released by "delete_volume" :: held 1.704s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Created reservations ['34ce2172-111c-4c7d-82fa-4aaddbe9946a', 'a3967238-06b3-4231-a62d-9ef63f9f54fe', '23da2a1c-82f6-418e-b7c4-ec1e9775e893', '336acf76-027b-4ccc-aa4c-2c8db19f5b21'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:36 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:36 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:36 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc.50b96b8e-5da9-49f2-ab5c-d90454c96d58" returned: 0 in 1.162s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-50b96b8e-5da9-49f2-ab5c-d90454c96d58" released by "_delete_snapshot" :: held 3.906s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" released by "delete_snapshot" :: held 3.918s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Created reservations ['7c2e0be5-01cd-4e46-ada7-01373d4b17ca', '6475e2ec-e512-4de6-9001-00ae5ef420f7', '77b12c36-c9a1-40f5-b79c-0eac10280416', '8c555f32-a2fd-4eeb-a9e6-2425583f5528'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:36 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Delete snapshot completed successfully.
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-50b96b8e-5da9-49f2-ab5c-d90454c96d58-delete_snapshot" released by "delete_snapshot" :: held 4.145s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Snapshots deleted, issuing volume delete {{(pid=83205) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" acquired by "delete_volume" :: waited 0.037s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:37 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e8048e-8b73-460e-8298-b39bfe481538]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:37 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.879s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:37 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Deleted volume successfully.
Apr 16 02:38:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ab43c4c9-b2a2-4fba-98b6-56f317a8e28b tempest-VolumeQuotasNegativeTestJSON-168925765 None] Lock "cinder-12669121-1525-4dbe-acfa-73b52fb55021-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:37 devstack sudo[86448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc
Apr 16 02:38:37 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:38 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" returned: 0 in 1.084s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:38 devstack sudo[86453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc
Apr 16 02:38:38 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:39 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" returned: 0 in 1.074s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-fd2a35c3-4b55-4efa-a0ad-926c31795bfc" released by "delete_volume" :: held 2.235s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Created reservations ['29397901-be74-4b62-a2ad-6ec10f95c70c', '8cbc9e87-1a50-434e-b139-19172a2c81ca', 'e99890aa-2b24-4081-9b0e-f78c400bb0b7', 'f3272b8c-9e9c-4ef6-995b-5fa7c496a7dc'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:39 devstack sudo[86460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:39 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:40 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.702s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:40 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Deleted volume successfully.
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-257df56c-7af9-4830-bce1-579d5cb45d57 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-fd2a35c3-4b55-4efa-a0ad-926c31795bfc-delete_volume" released by "delete_volume" :: held 10.752s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Flow 'volume_create_manager' (dadb653c-599b-401b-a712-ae20484ad2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaee0ac-31f9-4ded-8f07-88f11b100258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaee0ac-31f9-4ded-8f07-88f11b100258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-795116523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a64fe99-f5ee-45fd-b1b0-811bcd740d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1450e25d222840ae8c3b93993ce73354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:41Z,use_quota=True,user_id='0ada3e7043e14918ac5097d2f0abd431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044402d2-9937-42a0-a458-1f56b306e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044402d2-9937-42a0-a458-1f56b306e182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5485e970-7f78-45f7-a78d-aa945e5f4742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5485e970-7f78-45f7-a78d-aa945e5f4742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a64fe99-f5ee-45fd-b1b0-811bcd740d5d', 'volume_name': 'volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3187d1-5ca3-40a2-a48b-d308770ec201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3187d1-5ca3-40a2-a48b-d308770ec201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be9617d-26af-4963-8ecc-455a08ec7e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Volume 5a64fe99-f5ee-45fd-b1b0-811bcd740d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d', 'volume_size': 1}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-795116523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a64fe99-f5ee-45fd-b1b0-811bcd740d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1450e25d222840ae8c3b93993ce73354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:41Z,use_quota=True,user_id='0ada3e7043e14918ac5097d2f0abd431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Creating volume 5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:40 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:40 devstack sudo[86465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d 1073741824
Apr 16 02:38:40 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:41 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d 1073741824" returned: 0 in 0.690s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:41 devstack sudo[86470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d
Apr 16 02:38:41 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Flow 'volume_create_manager' (32064c09-71b3-4208-b99c-1f4069eba0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f02b5b7-ce37-49b0-91f2-3c39d5dc4bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f02b5b7-ce37-49b0-91f2-3c39d5dc4bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1041563583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae6e830-0ecd-48ef-8537-199bb3a90c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfef1808efd84665a23345d7ff369867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:42Z,use_quota=True,user_id='b7a57458132248cf82c326fde773c225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888ebc32-54a4-48a1-93fa-9b3dcc28508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888ebc32-54a4-48a1-93fa-9b3dcc28508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001bae8d-1374-4bda-9229-5d6b9ca94705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001bae8d-1374-4bda-9229-5d6b9ca94705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae6e830-0ecd-48ef-8537-199bb3a90c8a', 'volume_name': 'volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2ec00-858a-4b55-934e-c120f370eaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2ec00-858a-4b55-934e-c120f370eaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caf5ff5-4690-422c-88ea-01e0d78ff5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:42 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Volume dae6e830-0ecd-48ef-8537-199bb3a90c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a', 'volume_size': 1}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:42 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" returned: 0 in 0.749s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.284s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1041563583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae6e830-0ecd-48ef-8537-199bb3a90c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfef1808efd84665a23345d7ff369867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:42Z,use_quota=True,user_id='b7a57458132248cf82c326fde773c225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Creating volume dae6e830-0ecd-48ef-8537-199bb3a90c8a {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:42 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be9617d-26af-4963-8ecc-455a08ec7e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7998b8f-1b3d-4cd0-a68f-062913dc11d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:42 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a 1073741824
Apr 16 02:38:42 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:42 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Volume volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d (5a64fe99-f5ee-45fd-b1b0-811bcd740d5d): created successfully
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7998b8f-1b3d-4cd0-a68f-062913dc11d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Flow 'volume_create_manager' (dadb653c-599b-401b-a712-ae20484ad2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:42 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d812deb8-76f2-42ef-b7df-f1fa95b3b69c tempest-VolumesDeleteCascade-680569093 None] Created volume successfully.
Apr 16 02:38:42 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a 1073741824" returned: 0 in 0.586s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:43 devstack sudo[86484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a
Apr 16 02:38:43 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:43 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a" returned: 0 in 0.592s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.426s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caf5ff5-4690-422c-88ea-01e0d78ff5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2301fc3d-f81e-45b8-8615-07115e4ff928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Creating offline snapshot cd052a8f-a109-4130-a82b-07d78484a2dc of volume 5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:38:43 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Volume volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a (dae6e830-0ecd-48ef-8537-199bb3a90c8a): created successfully
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2301fc3d-f81e-45b8-8615-07115e4ff928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Flow 'volume_create_manager' (32064c09-71b3-4208-b99c-1f4069eba0c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e7b2aa-ff47-46be-b95a-b5948c81afd4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-cf4f8b73-a94d-4e8e-9ce0-e8536e681935 tempest-VolumesServicesTestJSON-786768405 None] Created volume successfully.
Apr 16 02:38:43 devstack sudo[86487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d
Apr 16 02:38:43 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Acquiring lock "cinder-dae6e830-0ecd-48ef-8537-199bb3a90c8a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Lock "cinder-dae6e830-0ecd-48ef-8537-199bb3a90c8a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Acquiring lock "cinder-quobyte-dae6e830-0ecd-48ef-8537-199bb3a90c8a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Lock "cinder-quobyte-dae6e830-0ecd-48ef-8537-199bb3a90c8a" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:44 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" returned: 0 in 0.729s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad388f2c-d169-4254-8719-de13697a1ae5]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:44 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc 1G
Apr 16 02:38:44 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:44 devstack sudo[86493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a
Apr 16 02:38:44 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:45 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a" returned: 0 in 0.721s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:45 devstack sudo[86503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a
Apr 16 02:38:45 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:45 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc 1G" returned: 0 in 0.816s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:45 devstack sudo[86505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc
Apr 16 02:38:45 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:45 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dae6e830-0ecd-48ef-8537-199bb3a90c8a" returned: 0 in 0.722s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Lock "cinder-quobyte-dae6e830-0ecd-48ef-8537-199bb3a90c8a" released by "delete_volume" :: held 1.472s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Created reservations ['2dbe4e95-dec5-4220-a568-814df88a3531', '56b064d2-677d-498f-83ec-86537d459c6a', '34f981eb-d056-4174-b55a-3d536858bc2c', '442d8803-bcb4-415d-b98b-b5d8479d8ba0'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:38:45 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc" returned: 0 in 0.700s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:45 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc is being set with open permissions: ugo+rw
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:45 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc
Apr 16 02:38:45 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:45 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:38:45 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:46 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.503s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:46 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:38:46 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Deleted volume successfully.
Apr 16 02:38:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-59824589-1acc-44ca-ade1-6f9776f8dea4 tempest-VolumesServicesTestJSON-786768405 None] Lock "cinder-dae6e830-0ecd-48ef-8537-199bb3a90c8a-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:46 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc" returned: 0 in 0.765s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:46 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:UPDATE=138,cinder:SELECT=110,cinder:INSERT=37,cinder:DELETE=13 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:38:46 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=115,cinder:INSERT=38,cinder:UPDATE=153,cinder:DELETE=10 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:38:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:46 devstack sudo[86534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.info
Apr 16 02:38:46 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:47 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.info" returned: 0 in 0.806s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:47 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.info is being set with open permissions: ugo+rw
Apr 16 02:38:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:47 devstack sudo[86538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.info
Apr 16 02:38:47 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:47 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.info" returned: 0 in 0.487s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.400s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:48 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-948bb8e8-fe81-4619-8194-9c84dcdb6e01 tempest-VolumesDeleteCascade-680569093 None] Create snapshot completed successfully
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Flow 'volume_create_manager' (9140c1ca-2cdf-4501-91fa-2de2c25213c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801d1f94-ef17-4927-a46a-627f9213db35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801d1f94-ef17-4927-a46a-627f9213db35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:48Z,deleted=False,deleted_at=None,display_description='',display_name='58d4d5ae-90d1-4f60-bc77-bf5ccbf5ad43-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033117d90ee847b7b96237c8f43af56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:49Z,use_quota=True,user_id='e71e2f0a0eb3459cb5d208358fcdb33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155e64a9-5fca-4384-90ca-814514956b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155e64a9-5fca-4384-90ca-814514956b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9aa219b-dd4f-48bc-a938-9dfd4e722818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9aa219b-dd4f-48bc-a938-9dfd4e722818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b', 'volume_name': 'volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c037b88-30c3-4024-9012-688811047588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c037b88-30c3-4024-9012-688811047588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1d3a62-0473-4020-a189-e99f606f514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Volume 5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b', 'volume_size': 1}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:48Z,deleted=False,deleted_at=None,display_description='',display_name='58d4d5ae-90d1-4f60-bc77-bf5ccbf5ad43-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033117d90ee847b7b96237c8f43af56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:49Z,use_quota=True,user_id='e71e2f0a0eb3459cb5d208358fcdb33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Creating volume 5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:48 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:48 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b 1073741824
Apr 16 02:38:48 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Flow 'volume_create_manager' (b461eeeb-78e6-471b-a114-66d3cd3f351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c038974a-1e25-447d-a659-9269ba3d55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c038974a-1e25-447d-a659-9269ba3d55d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-59302616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd78954-3584-4b53-b51e-55b295ef8232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1450e25d222840ae8c3b93993ce73354',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd052a8f-a109-4130-a82b-07d78484a2dc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:49Z,use_quota=True,user_id='0ada3e7043e14918ac5097d2f0abd431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecb2583-f2ed-492e-99a5-3330a60d5c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecb2583-f2ed-492e-99a5-3330a60d5c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d0be1b-e151-4711-9c2f-39d61f3aa721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d0be1b-e151-4711-9c2f-39d61f3aa721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fd78954-3584-4b53-b51e-55b295ef8232', 'volume_name': 'volume-1fd78954-3584-4b53-b51e-55b295ef8232', 'volume_size': 1, 'snapshot_id': 'cd052a8f-a109-4130-a82b-07d78484a2dc'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64415d31-a00c-418f-bf59-e1adc775ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64415d31-a00c-418f-bf59-e1adc775ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1def7c53-fdfc-4989-b8d5-86184ae3c4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:49 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Volume 1fd78954-3584-4b53-b51e-55b295ef8232: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fd78954-3584-4b53-b51e-55b295ef8232', 'volume_size': 1, 'snapshot_id': 'cd052a8f-a109-4130-a82b-07d78484a2dc'}
Apr 16 02:38:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:49 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b 1073741824" returned: 0 in 0.807s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:49 devstack sudo[86549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b
Apr 16 02:38:49 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:50 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b" returned: 0 in 0.508s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.023s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-cd052a8f-a109-4130-a82b-07d78484a2dc-1fd78954-3584-4b53-b51e-55b295ef8232" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1d3a62-0473-4020-a189-e99f606f514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae3f3c7-f9f2-42fe-b474-d76a6055303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:50 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Volume volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b (5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b): created successfully
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae3f3c7-f9f2-42fe-b474-d76a6055303c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Flow 'volume_create_manager' (9140c1ca-2cdf-4501-91fa-2de2c25213c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-cd052a8f-a109-4130-a82b-07d78484a2dc-1fd78954-3584-4b53-b51e-55b295ef8232" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Creating volume 1fd78954-3584-4b53-b51e-55b295ef8232 from snapshot cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-1fd78954-3584-4b53-b51e-55b295ef8232" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-1fd78954-3584-4b53-b51e-55b295ef8232" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] snapshot: cd052a8f-a109-4130-a82b-07d78484a2dc, volume: 1fd78954-3584-4b53-b51e-55b295ef8232,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:38:50 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-1d2a76f7-6c6e-4c35-95e7-0e79e0397526 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Created volume successfully.
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b4448b-a598-4a82-a1dc-5b0cdcb7ce67]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:50 devstack sudo[86552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc
Apr 16 02:38:50 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:50 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc" returned: 0 in 0.679s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[62724495-e892-4f8a-97d2-df7b9cfe6c17]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:50 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d
Apr 16 02:38:50 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:51 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" returned: 0 in 0.618s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:51 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:38:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:51 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232
Apr 16 02:38:51 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-a73efcda-6a87-40c4-bdda-42013fd585cb tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:55 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232" returned: 0 in 4.363s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:55 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c56b415-03e5-421b-83d4-80d1e5bbf3b1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:56 devstack sudo[86635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d
Apr 16 02:38:56 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (6af2e32b-2dac-422e-9b0f-7d331cf11fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa45a94-233c-476e-aa8e-cc007c8683cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa45a94-233c-476e-aa8e-cc007c8683cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-321640198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825f927d-50f1-4a5b-873f-54242bee91f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:56Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929c3fad-5797-4759-a71a-78f24e307b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929c3fad-5797-4759-a71a-78f24e307b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074f7865-77ca-4f99-8575-77b109575c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074f7865-77ca-4f99-8575-77b109575c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825f927d-50f1-4a5b-873f-54242bee91f0', 'volume_name': 'volume-825f927d-50f1-4a5b-873f-54242bee91f0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8fe68f-4fe0-4360-a6ac-df8b05cb4990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8fe68f-4fe0-4360-a6ac-df8b05cb4990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6580318-4d2f-4543-87e6-22c695cc1e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:56 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Volume 825f927d-50f1-4a5b-873f-54242bee91f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825f927d-50f1-4a5b-873f-54242bee91f0', 'volume_size': 1}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:56 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" returned: 0 in 0.991s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:38:56 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Converted 1024.00 MB image at 234.65 MB/s
Apr 16 02:38:56 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232 is being set with open permissions: ugo+rw
Apr 16 02:38:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:56 devstack sudo[86640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232
Apr 16 02:38:56 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:57 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232" returned: 0 in 0.786s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-1fd78954-3584-4b53-b51e-55b295ef8232" released by "_copy_volume_from_snapshot" :: held 7.534s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Flow 'volume_create_manager' (d84ba712-2d1c-4225-900d-9f8914b08c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ad280d-2156-489c-a73c-931c67a65ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-cd052a8f-a109-4130-a82b-07d78484a2dc-1fd78954-3584-4b53-b51e-55b295ef8232" released by "_create_volume_from_snapshot" :: held 7.589s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.633s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ad280d-2156-489c-a73c-931c67a65ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-342041637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7311cb-8183-4f80-9a18-e3997ad907d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2096168189ae436c94f4cc4d2ac5307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:58Z,use_quota=True,user_id='5b2969d199214b92a2486e3c32e3ef52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e2e873-1116-4d3f-b78a-cddcb5fd4a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e2e873-1116-4d3f-b78a-cddcb5fd4a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879695d4-77c8-4720-8671-b962b0da26f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879695d4-77c8-4720-8671-b962b0da26f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7311cb-8183-4f80-9a18-e3997ad907d7', 'volume_name': 'volume-1c7311cb-8183-4f80-9a18-e3997ad907d7', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f75713c-8fa9-4b7a-af54-132db17159f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f75713c-8fa9-4b7a-af54-132db17159f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2999438f-7129-4766-8e2f-8aaabb761f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:57 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Volume 1c7311cb-8183-4f80-9a18-e3997ad907d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7311cb-8183-4f80-9a18-e3997ad907d7', 'volume_size': 1}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-342041637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7311cb-8183-4f80-9a18-e3997ad907d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2096168189ae436c94f4cc4d2ac5307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:58Z,use_quota=True,user_id='5b2969d199214b92a2486e3c32e3ef52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Creating volume 1c7311cb-8183-4f80-9a18-e3997ad907d7 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:57 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1def7c53-fdfc-4989-b8d5-86184ae3c4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd78954-3584-4b53-b51e-55b295ef8232', 'volume_size': 1, 'snapshot_id': 'cd052a8f-a109-4130-a82b-07d78484a2dc'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c01a4b3-af13-4758-9337-74b2a6d6aed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:57 devstack sudo[86655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7 1073741824
Apr 16 02:38:57 devstack sudo[86655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:57 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Volume volume-1fd78954-3584-4b53-b51e-55b295ef8232 (1fd78954-3584-4b53-b51e-55b295ef8232): created successfully
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c01a4b3-af13-4758-9337-74b2a6d6aed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Flow 'volume_create_manager' (b461eeeb-78e6-471b-a114-66d3cd3f351b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:57 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-96bf4108-ad83-4d60-b0ab-9f699d579fa3 tempest-VolumesDeleteCascade-680569093 None] Created volume successfully.
Apr 16 02:38:58 devstack sudo[86655]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7 1073741824" returned: 0 in 0.560s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:58 devstack sudo[86661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7
Apr 16 02:38:58 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Performing cascade delete. {{(pid=83205) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-cd052a8f-a109-4130-a82b-07d78484a2dc-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-cd052a8f-a109-4130-a82b-07d78484a2dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-cd052a8f-a109-4130-a82b-07d78484a2dc" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-cd052a8f-a109-4130-a82b-07d78484a2dc" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Deleting offline snapshot cd052a8f-a109-4130-a82b-07d78484a2dc of volume 5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] snapshot_file for this snap is: volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0de01f-e322-4585-91aa-bef1c59c48cc]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:58 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7" returned: 0 in 0.570s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.449s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-321640198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825f927d-50f1-4a5b-873f-54242bee91f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:38:56Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Creating volume 825f927d-50f1-4a5b-873f-54242bee91f0 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:58 devstack sudo[86664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc
Apr 16 02:38:58 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:38:58 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2999438f-7129-4766-8e2f-8aaabb761f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7311cb-8183-4f80-9a18-e3997ad907d7', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:58 devstack sudo[86666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0 1073741824
Apr 16 02:38:58 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c689c18e-7180-4fab-aad0-940848272f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:38:59 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Volume volume-1c7311cb-8183-4f80-9a18-e3997ad907d7 (1c7311cb-8183-4f80-9a18-e3997ad907d7): created successfully
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c689c18e-7180-4fab-aad0-940848272f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Flow 'volume_create_manager' (d84ba712-2d1c-4225-900d-9f8914b08c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:38:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c9d83117-24ee-42f7-b82d-012de576a8f8 tempest-VolumesTransfersTest-636304174 None] Created volume successfully.
Apr 16 02:38:59 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc" returned: 0 in 0.526s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06a9a7-4dce-4163-931d-db6e37283fef]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:59 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d
Apr 16 02:38:59 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:59 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0 1073741824" returned: 0 in 0.723s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:38:59 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0
Apr 16 02:38:59 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:38:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:00 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:00 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:00 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" returned: 0 in 1.083s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:00 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc
Apr 16 02:39:00 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:00 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0" returned: 0 in 0.839s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-a73efcda-6a87-40c4-bdda-42013fd585cb tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.022s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6580318-4d2f-4543-87e6-22c695cc1e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825f927d-50f1-4a5b-873f-54242bee91f0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392dccae-8b7a-48dd-86dd-33ee2a6348aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fbb72e-4fa7-4588-8bb7-3c1bd95d2840]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-a73efcda-6a87-40c4-bdda-42013fd585cb tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:00 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Volume volume-825f927d-50f1-4a5b-873f-54242bee91f0 (825f927d-50f1-4a5b-873f-54242bee91f0): created successfully
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392dccae-8b7a-48dd-86dd-33ee2a6348aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (6af2e32b-2dac-422e-9b0f-7d331cf11fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-03f2519c-5002-409f-9b6a-d0af15658c15 tempest-VolumesActionsTest-374705788 None] Created volume successfully.
Apr 16 02:39:00 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b
Apr 16 02:39:00 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-dbb1edc1-933a-45ab-8ca0-12af84835264 tempest-VolumesTransfersTest-238654008 None] Transfer volume completed successfully.
Apr 16 02:39:01 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.365s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:01 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-a73efcda-6a87-40c4-bdda-42013fd585cb tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b" returned: 0 in 1.036s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-a73efcda-6a87-40c4-bdda-42013fd585cb tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.089s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-a73efcda-6a87-40c4-bdda-42013fd585cb tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5', 'name': 'volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c893f73f-6e85-44d9-9582-eeb6bbf6f799', 'enforce_multipath': True} {{(pid=83205) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 16 02:39:01 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc" returned: 0 in 1.281s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:01 devstack sudo[86729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc
Apr 16 02:39:01 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:01 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-c85b7fd4-4e1d-46b3-a37e-0bfd51181fc4 req-a73efcda-6a87-40c4-bdda-42013fd585cb tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] attachment_update completed successfully.
Apr 16 02:39:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-429841df-e511-4c2e-a92c-59056154d2ea tempest-VolumesActionsTest-374705788 None] Acquiring lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0" by "attach_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-429841df-e511-4c2e-a92c-59056154d2ea tempest-VolumesActionsTest-374705788 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0" acquired by "attach_volume" :: waited 0.029s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-429841df-e511-4c2e-a92c-59056154d2ea tempest-VolumesActionsTest-374705788 None] Attaching volume 825f927d-50f1-4a5b-873f-54242bee91f0 to instance 63db4c92-cb7f-4260-89e9-f3804dc3b653 at mountpoint /dev/vdb on host None.
Apr 16 02:39:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-429841df-e511-4c2e-a92c-59056154d2ea tempest-VolumesActionsTest-374705788 None] Attach volume completed successfully.
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-429841df-e511-4c2e-a92c-59056154d2ea tempest-VolumesActionsTest-374705788 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0" released by "attach_volume" :: held 0.172s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Acquiring lock "cinder-1c7311cb-8183-4f80-9a18-e3997ad907d7-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-1c7311cb-8183-4f80-9a18-e3997ad907d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Acquiring lock "cinder-quobyte-1c7311cb-8183-4f80-9a18-e3997ad907d7" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-quobyte-1c7311cb-8183-4f80-9a18-e3997ad907d7" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[521a40da-0aeb-4aea-b4cc-8ed5c4a78e02]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:02 devstack sudo[86732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7
Apr 16 02:39:02 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:02 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d.cd052a8f-a109-4130-a82b-07d78484a2dc" returned: 0 in 0.940s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-cd052a8f-a109-4130-a82b-07d78484a2dc" released by "_delete_snapshot" :: held 3.922s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" released by "delete_snapshot" :: held 3.937s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Created reservations ['dfb4ba9e-c23b-4489-8700-84bf7d985fc2', 'fef40321-07db-4289-93cf-fb9d981cc99e', '5341e7a0-0b2b-48b3-be58-289ac2c35132', 'ce2d22cc-c673-4571-805c-36708bc2401e'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Delete snapshot completed successfully.
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-cd052a8f-a109-4130-a82b-07d78484a2dc-delete_snapshot" released by "delete_snapshot" :: held 4.112s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Snapshots deleted, issuing volume delete {{(pid=83205) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" acquired by "delete_volume" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b3aa16-a6ba-4eac-afe0-05e28a44e594]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7fd7fd2b-2342-472c-8b4b-5a5a88c51518 tempest-VolumesActionsTest-890236287 None] Terminate volume connection completed successfully.
Apr 16 02:39:03 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d
Apr 16 02:39:03 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:03 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7" returned: 0 in 0.857s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:03 devstack sudo[86739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7
Apr 16 02:39:03 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd7fd2b-2342-472c-8b4b-5a5a88c51518 tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-detach_volume" by "detach_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd7fd2b-2342-472c-8b4b-5a5a88c51518 tempest-VolumesActionsTest-890236287 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7fd7fd2b-2342-472c-8b4b-5a5a88c51518 tempest-VolumesActionsTest-890236287 None] Detaching volume 825f927d-50f1-4a5b-873f-54242bee91f0 from instance 63db4c92-cb7f-4260-89e9-f3804dc3b653.
Apr 16 02:39:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7fd7fd2b-2342-472c-8b4b-5a5a88c51518 tempest-VolumesActionsTest-890236287 None] Detach volume completed successfully.
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd7fd2b-2342-472c-8b4b-5a5a88c51518 tempest-VolumesActionsTest-890236287 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:03 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" returned: 0 in 0.580s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:03 devstack sudo[86744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d
Apr 16 02:39:03 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:03 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1c7311cb-8183-4f80-9a18-e3997ad907d7" returned: 0 in 0.616s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-quobyte-1c7311cb-8183-4f80-9a18-e3997ad907d7" released by "delete_volume" :: held 1.538s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Created reservations ['a971aebf-4208-4b4f-9d28-c9bf7f7cc1d8', '74866b01-2590-4e34-b375-05a8c2679418', 'd4e8faae-47ba-47cc-90da-91d8f0b2d1fb', '315fb4d4-1e31-4e9b-9fe4-afc3ee38cf7a'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:04 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:04 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:04 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" returned: 0 in 0.557s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d" released by "delete_volume" :: held 1.256s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2e341b41-80f8-47ac-88c7-95c45e242967 tempest-VolumesActionsTest-374705788 None] Acquiring lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-detach_volume" by "detach_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2e341b41-80f8-47ac-88c7-95c45e242967 tempest-VolumesActionsTest-374705788 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:04 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2e341b41-80f8-47ac-88c7-95c45e242967 tempest-VolumesActionsTest-374705788 None] Volume detach called, but volume not attached.
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2e341b41-80f8-47ac-88c7-95c45e242967 tempest-VolumesActionsTest-374705788 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-detach_volume" released by "detach_volume" :: held 0.015s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Created reservations ['7a0ac4c0-7e7c-49af-b116-6fbb77d287d7', 'd012c2ed-689b-4e3a-ace6-ca7e277c4ab0', '3c91e939-612d-442e-9536-28d518f79ab0', '97a038a2-ff92-4637-919c-212d1ab000a2'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:04 devstack sudo[86817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:04 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:04 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.436s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:04 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Deleted volume successfully.
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b4ead79a-fe0b-4cd2-9b1b-faacaa904cf5 tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-1c7311cb-8183-4f80-9a18-e3997ad907d7-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:04 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:04 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Deleted volume successfully.
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d63ae71d-27bf-4735-b591-16c65bca6f20 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-5a64fe99-f5ee-45fd-b1b0-811bcd740d5d-delete_volume" released by "delete_volume" :: held 6.028s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Acquiring lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Flow 'volume_create_manager' (90271b2f-e01a-45e2-8da8-508a8d5a0faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686bc728-b37c-407b-b0c1-8efcd2a56a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Acquiring lock "cinder-quobyte-825f927d-50f1-4a5b-873f-54242bee91f0" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686bc728-b37c-407b-b0c1-8efcd2a56a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-478798863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2096168189ae436c94f4cc4d2ac5307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:05Z,use_quota=True,user_id='5b2969d199214b92a2486e3c32e3ef52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20932e-7007-4da9-932f-35166fa1de6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a20932e-7007-4da9-932f-35166fa1de6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a044afb7-1b46-48f0-a678-fb07a757657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a044afb7-1b46-48f0-a678-fb07a757657f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e', 'volume_name': 'volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe32ef79-8a76-44d7-8391-0c0818aa67ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe32ef79-8a76-44d7-8391-0c0818aa67ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95989e0-1192-4bed-92f1-14f716c0fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:05 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Volume f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e', 'volume_size': 1}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-478798863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2096168189ae436c94f4cc4d2ac5307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:05Z,use_quota=True,user_id='5b2969d199214b92a2486e3c32e3ef52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Creating volume f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:05 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Lock "cinder-quobyte-825f927d-50f1-4a5b-873f-54242bee91f0" acquired by "delete_volume" :: waited 0.066s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:05 devstack sudo[86822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e 1073741824
Apr 16 02:39:05 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0f275e-e806-4890-ba84-d4f62dfbbf90]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:05 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0
Apr 16 02:39:05 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-1fd78954-3584-4b53-b51e-55b295ef8232-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-1fd78954-3584-4b53-b51e-55b295ef8232-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "cinder-quobyte-1fd78954-3584-4b53-b51e-55b295ef8232" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-1fd78954-3584-4b53-b51e-55b295ef8232" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74ea328-1804-4186-8ba9-6e5d784d60c7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:05 devstack sudo[86829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232
Apr 16 02:39:05 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:05 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e 1073741824" returned: 0 in 0.675s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:05 devstack sudo[86837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e
Apr 16 02:39:05 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:05 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0" returned: 0 in 0.696s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:05 devstack sudo[86839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0
Apr 16 02:39:05 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:06 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232" returned: 0 in 0.659s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:06 devstack sudo[86844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232
Apr 16 02:39:06 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:06 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e" returned: 0 in 0.461s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95989e0-1192-4bed-92f1-14f716c0fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aece0df-645d-4501-8660-8b8a03a41d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:06 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Volume volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e (f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e): created successfully
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aece0df-645d-4501-8660-8b8a03a41d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Flow 'volume_create_manager' (90271b2f-e01a-45e2-8da8-508a8d5a0faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ae25cffb-86ab-470f-9873-740d2ed673c8 tempest-VolumesTransfersTest-636304174 None] Created volume successfully.
Apr 16 02:39:06 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-825f927d-50f1-4a5b-873f-54242bee91f0" returned: 0 in 0.483s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Lock "cinder-quobyte-825f927d-50f1-4a5b-873f-54242bee91f0" released by "delete_volume" :: held 1.221s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Created reservations ['e686fd88-6bb4-4c17-a597-825314e34941', '716e0fa8-3ad9-4c42-ae1d-b5708bb57a93', '28087c95-988e-41f2-87c3-1d35dc2b69f3', '88246d90-9739-4c35-be40-e86b1861fbfa'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:06 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:06 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:06 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1fd78954-3584-4b53-b51e-55b295ef8232" returned: 0 in 0.507s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-quobyte-1fd78954-3584-4b53-b51e-55b295ef8232" released by "delete_volume" :: held 1.194s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Created reservations ['2c39adc1-ea0f-46e0-81dd-38356722bb2f', 'ce993f75-e535-4d47-ac97-89a0ce4b837e', '0888cf27-3bc1-49d9-ac97-c8f69c1f1974', '6ab2669e-738b-4b8c-b424-5d71ad8711fe'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:06 devstack sudo[87179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:06 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:06 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.603s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Deleted volume successfully.
Apr 16 02:39:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-87b42109-1656-4d27-be62-5e08a57a5fcc tempest-VolumesActionsTest-374705788 None] Lock "cinder-825f927d-50f1-4a5b-873f-54242bee91f0-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:07 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.670s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:07 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Deleted volume successfully.
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3e641869-a1c8-4836-8251-2c41e76026b8 tempest-VolumesDeleteCascade-680569093 None] Lock "cinder-1fd78954-3584-4b53-b51e-55b295ef8232-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Acquiring lock "cinder-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Acquiring lock "cinder-quobyte-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-quobyte-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[84893bd6-ac87-4aea-b3f5-bf9b2b026a3b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:07 devstack sudo[87196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e
Apr 16 02:39:07 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:08 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e" returned: 0 in 0.696s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:08 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e
Apr 16 02:39:08 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:09 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e" returned: 0 in 0.734s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-quobyte-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e" released by "delete_volume" :: held 1.480s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Created reservations ['7830028f-6e33-4c4c-ba18-ffa40d29bcf0', '4c021681-8555-49ee-adbc-6202b2f92e00', 'a6391b56-7209-43a5-874e-c6fb76bbd2a0', 'b9ddb3ec-d39e-4204-a5d3-670401d00434'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:09 devstack sudo[87232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:09 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:10 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.675s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:10 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Deleted volume successfully.
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0c4f8c65-5a87-4f29-a16a-b357eb6548de tempest-VolumesTransfersTest-1112441416 None] Lock "cinder-f3a2648f-6ab4-4546-a8ad-bdd9c36ee24e-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Flow 'volume_create_manager' (f50c4f91-d829-4231-ad8a-b8b0c845a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f894df6e-978f-416d-981c-5e5b96ed29b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f894df6e-978f-416d-981c-5e5b96ed29b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1665021991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8259445f-56b0-483e-b642-4ce150a76532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1119dc1b56140ff8ef39afb88626424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:11Z,use_quota=True,user_id='17ac576046cf4bcdb854ca5fc334e2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ee8448-291f-4393-8c49-f26a1cc1775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38ee8448-291f-4393-8c49-f26a1cc1775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a88710-40a8-436a-9e65-c6561640ad41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a88710-40a8-436a-9e65-c6561640ad41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8259445f-56b0-483e-b642-4ce150a76532', 'volume_name': 'volume-8259445f-56b0-483e-b642-4ce150a76532', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce0aa57-f128-45dd-bd47-48efd7e8617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce0aa57-f128-45dd-bd47-48efd7e8617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2b59a0-8bc2-46ff-a563-60653961c19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:10 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Volume 8259445f-56b0-483e-b642-4ce150a76532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8259445f-56b0-483e-b642-4ce150a76532', 'volume_size': 1}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1665021991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8259445f-56b0-483e-b642-4ce150a76532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1119dc1b56140ff8ef39afb88626424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:11Z,use_quota=True,user_id='17ac576046cf4bcdb854ca5fc334e2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Creating volume 8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:10 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:10 devstack sudo[87238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 1073741824
Apr 16 02:39:10 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:11 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 1073741824" returned: 0 in 0.640s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:11 devstack sudo[87245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532
Apr 16 02:39:11 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:11 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532" returned: 0 in 0.507s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2b59a0-8bc2-46ff-a563-60653961c19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8259445f-56b0-483e-b642-4ce150a76532', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fe28c7-21a0-4249-a29a-eacc74666973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Volume volume-8259445f-56b0-483e-b642-4ce150a76532 (8259445f-56b0-483e-b642-4ce150a76532): created successfully
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fe28c7-21a0-4249-a29a-eacc74666973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Flow 'volume_create_manager' (f50c4f91-d829-4231-ad8a-b8b0c845a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:11 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2d156d87-f40d-45b6-8f65-f5343a7072b1 tempest-VolumesCloneTest-140250549 None] Created volume successfully.
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Flow 'volume_create_manager' (88ce4125-15de-4e87-9afe-5255983db5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4a263e-82b6-4758-8b40-a67d3cebc085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4a263e-82b6-4758-8b40-a67d3cebc085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-221873827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cef615-9c88-4615-85ca-4d4ae78e5150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1119dc1b56140ff8ef39afb88626424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=8259445f-56b0-483e-b642-4ce150a76532,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:13Z,use_quota=True,user_id='17ac576046cf4bcdb854ca5fc334e2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6506619-06b6-4aa7-956e-180f2f23d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6506619-06b6-4aa7-956e-180f2f23d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d0c4ab-236d-4be6-99e8-843d63b66a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d0c4ab-236d-4be6-99e8-843d63b66a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57cef615-9c88-4615-85ca-4d4ae78e5150', 'volume_name': 'volume-57cef615-9c88-4615-85ca-4d4ae78e5150', 'volume_size': 2, 'source_volid': '8259445f-56b0-483e-b642-4ce150a76532', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f58a32-b602-460f-872c-f0533e096d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f58a32-b602-460f-872c-f0533e096d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e660fc-0044-4897-a59f-b69dcd45e8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:13 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Volume 57cef615-9c88-4615-85ca-4d4ae78e5150: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57cef615-9c88-4615-85ca-4d4ae78e5150', 'volume_size': 2, 'source_volid': '8259445f-56b0-483e-b642-4ce150a76532', 'source_volstatus': 'available'}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:13 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Cloning volume 8259445f-56b0-483e-b642-4ce150a76532 to volume 57cef615-9c88-4615-85ca-4d4ae78e5150
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Creating offline snapshot c680fded-a61e-4dc1-a809-222e524206cd of volume 8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8042c0ca-f81e-4cf2-8a5f-f51255eccb65]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:13 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532
Apr 16 02:39:13 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:13 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532" returned: 0 in 0.602s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:13 devstack sudo[87254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd 1G
Apr 16 02:39:13 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (a98f5192-5dcb-4cb8-b283-51e764172a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76faf6a7-e0a7-48e0-8d56-e8c6114bbea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76faf6a7-e0a7-48e0-8d56-e8c6114bbea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-425292783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ffd464-597a-4afc-9daf-703ecf9f6b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:14Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e14c2b1-acd8-4200-a7bf-f4dfa95dbca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e14c2b1-acd8-4200-a7bf-f4dfa95dbca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a0ee50-80a2-48a4-b8bb-5a1dc8ea5b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a0ee50-80a2-48a4-b8bb-5a1dc8ea5b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ffd464-597a-4afc-9daf-703ecf9f6b31', 'volume_name': 'volume-29ffd464-597a-4afc-9daf-703ecf9f6b31', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c79280-073b-4293-9dfa-2464fb70230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c79280-073b-4293-9dfa-2464fb70230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484b2652-5870-4f24-b09d-063ec8800a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Volume 29ffd464-597a-4afc-9daf-703ecf9f6b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ffd464-597a-4afc-9daf-703ecf9f6b31', 'volume_size': 1}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:14 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd 1G" returned: 0 in 0.787s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8259445f-56b0-483e-b642-4ce150a76532 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:14 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8259445f-56b0-483e-b642-4ce150a76532 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd
Apr 16 02:39:14 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:15 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8259445f-56b0-483e-b642-4ce150a76532 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:15 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd is being set with open permissions: ugo+rw
Apr 16 02:39:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:15 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd
Apr 16 02:39:15 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:15 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd" returned: 0 in 0.497s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:15 devstack sudo[87295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.info
Apr 16 02:39:15 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:16 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.info" returned: 0 in 0.567s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:16 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.info is being set with open permissions: ugo+rw
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:16 devstack sudo[87309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.info
Apr 16 02:39:16 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:16 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.info" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Acquiring lock "cinder-quobyte-57cef615-9c88-4615-85ca-4d4ae78e5150" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-57cef615-9c88-4615-85ca-4d4ae78e5150" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] snapshot: c680fded-a61e-4dc1-a809-222e524206cd, volume: 57cef615-9c88-4615-85ca-4d4ae78e5150,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b45013-05dd-4184-84df-54caef5b612a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:16 devstack sudo[87321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd
Apr 16 02:39:16 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:17 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd" returned: 0 in 0.630s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8259445f-56b0-483e-b642-4ce150a76532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:39:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:39:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:39:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff9e803-8aa0-46a6-8df5-7e03df3c1b4c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:17 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532
Apr 16 02:39:17 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:18 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532" returned: 0 in 0.620s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:18 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:39:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:18 devstack sudo[87331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150
Apr 16 02:39:18 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:20 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150" returned: 0 in 2.911s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[86905a09-a13f-4298-bfba-6a289fe1e0a8]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:21 devstack sudo[87374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532
Apr 16 02:39:21 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:22 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532" returned: 0 in 1.044s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532, size 1024.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:39:22 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Converted 1024.00 MB image at 351.55 MB/s
Apr 16 02:39:22 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150 is being set with open permissions: ugo+rw
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:22 devstack sudo[87380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150
Apr 16 02:39:22 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:22 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150" returned: 0 in 0.529s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-57cef615-9c88-4615-85ca-4d4ae78e5150" released by "_copy_volume_from_snapshot" :: held 5.861s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Acquiring lock "cinder-quobyte-c680fded-a61e-4dc1-a809-222e524206cd" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-c680fded-a61e-4dc1-a809-222e524206cd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Deleting offline snapshot c680fded-a61e-4dc1-a809-222e524206cd of volume 8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] snapshot_file for this snap is: volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[22501cc8-a63a-4615-b563-67f747e31208]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:22 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd
Apr 16 02:39:22 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:23 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd" returned: 0 in 0.672s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8259445f-56b0-483e-b642-4ce150a76532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:39:23 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2b4f58-b415-4f57-bcc2-1ad7ceac9635]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:23 devstack sudo[87390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532
Apr 16 02:39:23 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:24 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532" returned: 0 in 0.698s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:24 devstack sudo[87419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd
Apr 16 02:39:24 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:24 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd" returned: 0 in 0.752s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:24 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd
Apr 16 02:39:24 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:25 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532.c680fded-a61e-4dc1-a809-222e524206cd" returned: 0 in 0.583s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-c680fded-a61e-4dc1-a809-222e524206cd" released by "_delete_snapshot" :: held 2.799s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.242s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.083s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-425292783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ffd464-597a-4afc-9daf-703ecf9f6b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:14Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Creating volume 29ffd464-597a-4afc-9daf-703ecf9f6b31 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:25 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e660fc-0044-4897-a59f-b69dcd45e8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cef615-9c88-4615-85ca-4d4ae78e5150', 'volume_size': 2, 'source_volid': '8259445f-56b0-483e-b642-4ce150a76532', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0374ecee-112f-4d37-99fa-126e935d3280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:25 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31 1073741824
Apr 16 02:39:25 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:25 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Volume volume-57cef615-9c88-4615-85ca-4d4ae78e5150 (57cef615-9c88-4615-85ca-4d4ae78e5150): created successfully
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0374ecee-112f-4d37-99fa-126e935d3280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Flow 'volume_create_manager' (88ce4125-15de-4e87-9afe-5255983db5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-26d58c6c-d6fa-4df5-bd2d-0def3d34c095 tempest-VolumesCloneTest-140250549 None] Created volume successfully.
Apr 16 02:39:26 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31 1073741824" returned: 0 in 0.836s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Acquiring lock "cinder-57cef615-9c88-4615-85ca-4d4ae78e5150-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Lock "cinder-57cef615-9c88-4615-85ca-4d4ae78e5150-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:26 devstack sudo[87460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31
Apr 16 02:39:26 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Acquiring lock "cinder-quobyte-57cef615-9c88-4615-85ca-4d4ae78e5150" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-57cef615-9c88-4615-85ca-4d4ae78e5150" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3da078-59e0-44ef-a773-86eefb243624]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:26 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150
Apr 16 02:39:26 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Flow 'volume_create_manager' (80096b94-486b-4f38-8f50-459fef5be0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f6f738-9c12-4527-b95d-f61d7f167d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f6f738-9c12-4527-b95d-f61d7f167d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151605243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7c353c-5b47-4ac2-97f6-cf174df9748d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66860e2ed5db4af6b782563fbdb5e3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:27Z,use_quota=True,user_id='d8bb35742103400d8ff8420ce8d509ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6507b58-f497-4ab7-a929-0820cf6574ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6507b58-f497-4ab7-a929-0820cf6574ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810954bf-569f-4abd-bf6b-bdc0016b31f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810954bf-569f-4abd-bf6b-bdc0016b31f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7c353c-5b47-4ac2-97f6-cf174df9748d', 'volume_name': 'volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeceba24-384f-4e95-8bbe-687c242770e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeceba24-384f-4e95-8bbe-687c242770e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d567197-2ae2-4b02-af52-867399be7302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:26 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Volume fd7c353c-5b47-4ac2-97f6-cf174df9748d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d', 'volume_size': 1}
Apr 16 02:39:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:27 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31" returned: 0 in 0.618s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151605243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7c353c-5b47-4ac2-97f6-cf174df9748d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66860e2ed5db4af6b782563fbdb5e3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:27Z,use_quota=True,user_id='d8bb35742103400d8ff8420ce8d509ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Creating volume fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:27 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484b2652-5870-4f24-b09d-063ec8800a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ffd464-597a-4afc-9daf-703ecf9f6b31', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d980b9-9a69-4518-9a16-fb46daddf00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:27 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Volume volume-29ffd464-597a-4afc-9daf-703ecf9f6b31 (29ffd464-597a-4afc-9daf-703ecf9f6b31): created successfully
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d980b9-9a69-4518-9a16-fb46daddf00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (a98f5192-5dcb-4cb8-b283-51e764172a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:27 devstack sudo[87484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d 1073741824
Apr 16 02:39:27 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-9934adce-9aea-470e-b945-436f9a48b2a6 tempest-VolumesActionsTest-374705788 None] Created volume successfully.
Apr 16 02:39:27 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150" returned: 0 in 0.759s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:27 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150
Apr 16 02:39:27 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-29ffd464-597a-4afc-9daf-703ecf9f6b31-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Lock "cinder-29ffd464-597a-4afc-9daf-703ecf9f6b31-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-quobyte-29ffd464-597a-4afc-9daf-703ecf9f6b31" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-29ffd464-597a-4afc-9daf-703ecf9f6b31" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[693a091b-8d56-4d29-84c8-34925617edd3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:27 devstack sudo[87500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31
Apr 16 02:39:27 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:27 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d 1073741824" returned: 0 in 0.863s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:27 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:39:27 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:28 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-57cef615-9c88-4615-85ca-4d4ae78e5150" returned: 0 in 0.733s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-57cef615-9c88-4615-85ca-4d4ae78e5150" released by "delete_volume" :: held 1.519s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Created reservations ['c25ce2d6-3a03-4b57-a3ea-8a9f186a0202', 'd73b991b-bd16-46df-b91d-5876bc1e198e', '220394ec-5690-4b17-bb6c-4f08dc93bc41', 'ffad2b2e-8237-4881-8cd9-6810cea7e4a4'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:28 devstack sudo[87505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:28 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:28 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31" returned: 0 in 0.503s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:28 devstack sudo[87511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31
Apr 16 02:39:28 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:28 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.459s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d567197-2ae2-4b02-af52-867399be7302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ba5e9a-5805-4ea7-876c-989b37d771ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:28 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Volume volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d (fd7c353c-5b47-4ac2-97f6-cf174df9748d): created successfully
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ba5e9a-5805-4ea7-876c-989b37d771ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Flow 'volume_create_manager' (80096b94-486b-4f38-8f50-459fef5be0be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-944e420d-90a3-4eba-b1b9-5885bb0a8e7f tempest-VolumesActionsTest-768136828 None] Created volume successfully.
Apr 16 02:39:28 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.472s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Deleted volume successfully.
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2411054f-cb43-45ed-9222-6cfeb4b5d2da tempest-VolumesCloneTest-140250549 None] Lock "cinder-57cef615-9c88-4615-85ca-4d4ae78e5150-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Acquiring lock "cinder-8259445f-56b0-483e-b642-4ce150a76532-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Lock "cinder-8259445f-56b0-483e-b642-4ce150a76532-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:28 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-29ffd464-597a-4afc-9daf-703ecf9f6b31" returned: 0 in 0.546s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-29ffd464-597a-4afc-9daf-703ecf9f6b31" released by "delete_volume" :: held 1.095s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Acquiring lock "cinder-quobyte-8259445f-56b0-483e-b642-4ce150a76532" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Created reservations ['4aa498ed-6341-44f4-8e1a-64d936dc5f77', '3dc71711-20ce-4902-a73e-60868feafebf', 'cd334f26-940c-4603-b043-1280703f8148', '6fd9deb4-4bb3-4ff6-a97e-aa73915313e2'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-8259445f-56b0-483e-b642-4ce150a76532" acquired by "delete_volume" :: waited 0.027s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fd92f3-1603-4b5a-98fd-cc798c27a1db]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:29 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:29 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:29 devstack sudo[87516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532
Apr 16 02:39:29 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:29 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.539s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:29 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Deleted volume successfully.
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d2f9923-6afa-4a0e-aa8b-1b76b8d31d2f tempest-VolumesActionsTest-890236287 None] Lock "cinder-29ffd464-597a-4afc-9daf-703ecf9f6b31-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:29 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532" returned: 0 in 0.650s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:29 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532
Apr 16 02:39:29 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:30 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8259445f-56b0-483e-b642-4ce150a76532" returned: 0 in 0.509s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Lock "cinder-quobyte-8259445f-56b0-483e-b642-4ce150a76532" released by "delete_volume" :: held 1.213s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Created reservations ['d880c5cc-4c55-4ab6-9be0-247b21e9bdc6', 'ff3b07f8-af5a-4caf-a5ed-589717ad4490', 'a4b3768e-6d46-4aed-9f61-ee965aa3c9f4', 'a2bdfee8-cffa-4be2-a026-71e3ca34cd33'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:30 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:30 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (d21902ad-0f1c-475e-a462-260aeb815a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c105e3-2720-4427-9097-6fb9f4ce5afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c105e3-2720-4427-9097-6fb9f4ce5afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014191906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d61b329-5d56-45b7-b11c-f1eafffdb07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:30Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553b6c95-e0a6-4334-86ad-46b3e02c9109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553b6c95-e0a6-4334-86ad-46b3e02c9109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e45a48-9215-4403-bef0-c3fac7d4f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e45a48-9215-4403-bef0-c3fac7d4f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d61b329-5d56-45b7-b11c-f1eafffdb07a', 'volume_name': 'volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51818a9-83a9-49a5-a220-91a400beae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51818a9-83a9-49a5-a220-91a400beae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db82d9eb-54a1-4b6f-bc88-48699c0f0953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:30 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Volume 5d61b329-5d56-45b7-b11c-f1eafffdb07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a', 'volume_size': 1}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014191906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d61b329-5d56-45b7-b11c-f1eafffdb07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:30Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Creating volume 5d61b329-5d56-45b7-b11c-f1eafffdb07a {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:30 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:30 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a 1073741824
Apr 16 02:39:30 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:30 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.516s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:30 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Deleted volume successfully.
Apr 16 02:39:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-56d65919-5fa6-46dc-b4a0-43d258715b4b tempest-VolumesCloneTest-140250549 None] Lock "cinder-8259445f-56b0-483e-b642-4ce150a76532-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:31 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a 1073741824" returned: 0 in 0.586s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:31 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a
Apr 16 02:39:31 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:31 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a" returned: 0 in 0.497s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db82d9eb-54a1-4b6f-bc88-48699c0f0953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cff756-3b9d-44c0-a324-97d636cc0c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:31 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Volume volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a (5d61b329-5d56-45b7-b11c-f1eafffdb07a): created successfully
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cff756-3b9d-44c0-a324-97d636cc0c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (d21902ad-0f1c-475e-a462-260aeb815a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-91f555b7-7da5-4bc0-89fe-7ae2405abb5f tempest-VolumesActionsTest-374705788 None] Created volume successfully.
Apr 16 02:39:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-5d61b329-5d56-45b7-b11c-f1eafffdb07a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Lock "cinder-5d61b329-5d56-45b7-b11c-f1eafffdb07a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-quobyte-5d61b329-5d56-45b7-b11c-f1eafffdb07a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-5d61b329-5d56-45b7-b11c-f1eafffdb07a" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:32 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[68172071-2349-402b-bf4a-065c0a13bd7c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:32 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a
Apr 16 02:39:32 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:33 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a" returned: 0 in 0.560s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:33 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a
Apr 16 02:39:33 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:33 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d61b329-5d56-45b7-b11c-f1eafffdb07a" returned: 0 in 0.477s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-5d61b329-5d56-45b7-b11c-f1eafffdb07a" released by "delete_volume" :: held 1.058s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Created reservations ['67422c77-167d-462a-a363-d463d66daf21', 'e553552a-158d-4838-8993-559b55411e12', '97e29134-9986-40d7-8c61-39279c31669c', 'f5027433-2aa4-462b-b033-a010040e3327'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:33 devstack sudo[87556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:33 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:34 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.520s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:34 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Deleted volume successfully.
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2353bb1-03b9-4f92-b385-38acbe0015e6 tempest-VolumesActionsTest-890236287 None] Lock "cinder-5d61b329-5d56-45b7-b11c-f1eafffdb07a-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Flow 'volume_create_manager' (a0948c48-f9b6-46e2-a891-997b89f68d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8c171c-af19-4269-bb18-11d26d832481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8c171c-af19-4269-bb18-11d26d832481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1011296770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58c3218-8730-44e7-a7f9-d53b03e6165e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52c01570ab64148a67d2b159d4b4bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:34Z,use_quota=True,user_id='6abae9e5c42f4583977dccfd9e80bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2e254e-5e1a-42fe-9d96-1032006a7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2e254e-5e1a-42fe-9d96-1032006a7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91532d96-308f-43b7-ac3c-675789dc2e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91532d96-308f-43b7-ac3c-675789dc2e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58c3218-8730-44e7-a7f9-d53b03e6165e', 'volume_name': 'volume-e58c3218-8730-44e7-a7f9-d53b03e6165e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08dacbf7-877c-4fd2-babb-efbf27bd14d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08dacbf7-877c-4fd2-babb-efbf27bd14d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f73564-ab0c-4987-82b3-69649bbdd2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:34 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Volume e58c3218-8730-44e7-a7f9-d53b03e6165e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58c3218-8730-44e7-a7f9-d53b03e6165e', 'volume_size': 1}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1011296770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58c3218-8730-44e7-a7f9-d53b03e6165e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52c01570ab64148a67d2b159d4b4bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:34Z,use_quota=True,user_id='6abae9e5c42f4583977dccfd9e80bf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Creating volume e58c3218-8730-44e7-a7f9-d53b03e6165e {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:34 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:34 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e 1073741824
Apr 16 02:39:34 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (96ae2a78-dbc6-48e8-a484-02fb4ff11898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb56af-f79d-4a53-91a7-56fe3a65a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dacb56af-f79d-4a53-91a7-56fe3a65a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-488413646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0f29b3-692d-4310-bfce-866c1bfa291d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:35Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d6f8dd-b19d-4250-abea-5b9dd5dd7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d6f8dd-b19d-4250-abea-5b9dd5dd7b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08b7000-a8af-43e5-a9dc-6c8a476a9172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08b7000-a8af-43e5-a9dc-6c8a476a9172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0f29b3-692d-4310-bfce-866c1bfa291d', 'volume_name': 'volume-2f0f29b3-692d-4310-bfce-866c1bfa291d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08af82d-0b4f-426e-98de-ee38071bb463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08af82d-0b4f-426e-98de-ee38071bb463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125e22f8-87e6-4f08-9f4e-f6ba19b4b8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:35 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Volume 2f0f29b3-692d-4310-bfce-866c1bfa291d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0f29b3-692d-4310-bfce-866c1bfa291d', 'volume_size': 1}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:35 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e 1073741824" returned: 0 in 0.723s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:35 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e
Apr 16 02:39:35 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:35 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e" returned: 0 in 0.493s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-488413646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0f29b3-692d-4310-bfce-866c1bfa291d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:35Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Creating volume 2f0f29b3-692d-4310-bfce-866c1bfa291d {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:35 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f73564-ab0c-4987-82b3-69649bbdd2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58c3218-8730-44e7-a7f9-d53b03e6165e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e9fd82-92d4-49d7-89c1-40ac4f341a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:35 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d 1073741824
Apr 16 02:39:35 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:35 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Volume volume-e58c3218-8730-44e7-a7f9-d53b03e6165e (e58c3218-8730-44e7-a7f9-d53b03e6165e): created successfully
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e9fd82-92d4-49d7-89c1-40ac4f341a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Flow 'volume_create_manager' (a0948c48-f9b6-46e2-a891-997b89f68d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b52fea04-d1c0-4124-a448-5bfd8227f6dc tempest-VolumesNegativeTest-250134586 None] Created volume successfully.
Apr 16 02:39:36 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d 1073741824" returned: 0 in 0.668s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:36 devstack sudo[87592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d
Apr 16 02:39:36 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:37 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d" returned: 0 in 0.516s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125e22f8-87e6-4f08-9f4e-f6ba19b4b8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0f29b3-692d-4310-bfce-866c1bfa291d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e489649-1a40-46ba-81ef-01ca493f498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:37 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Volume volume-2f0f29b3-692d-4310-bfce-866c1bfa291d (2f0f29b3-692d-4310-bfce-866c1bfa291d): created successfully
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e489649-1a40-46ba-81ef-01ca493f498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (96ae2a78-dbc6-48e8-a484-02fb4ff11898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1deae042-0b9a-47be-b3a4-e0f37704fedb tempest-VolumesActionsTest-374705788 None] Created volume successfully.
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-2f0f29b3-692d-4310-bfce-866c1bfa291d-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Lock "cinder-2f0f29b3-692d-4310-bfce-866c1bfa291d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-quobyte-2f0f29b3-692d-4310-bfce-866c1bfa291d" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-2f0f29b3-692d-4310-bfce-866c1bfa291d" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a765740-cb5b-4482-a088-9ed3a76c825e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:37 devstack sudo[87598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d
Apr 16 02:39:37 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:38 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d" returned: 0 in 0.664s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:38 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d
Apr 16 02:39:38 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:38 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2f0f29b3-692d-4310-bfce-866c1bfa291d" returned: 0 in 0.485s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-2f0f29b3-692d-4310-bfce-866c1bfa291d" released by "delete_volume" :: held 1.186s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Created reservations ['5d369c41-a5b0-4a5f-979a-954797ab4996', '50b32c95-18ec-4cea-98ba-bf970034c5cb', 'f1807043-4811-48eb-ae0e-6f9ed141bc45', '4869b281-8d78-40db-b236-5f51aa8780cf'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:38 devstack sudo[87623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:38 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:39 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.467s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Deleted volume successfully.
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-724490b1-8420-41be-9b44-46792250cc28 tempest-VolumesActionsTest-890236287 None] Lock "cinder-2f0f29b3-692d-4310-bfce-866c1bfa291d-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (d9b07772-d1d7-4a96-b3c2-43c561a5936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e98ed4-ecfa-483a-9e6a-1a36473c8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e98ed4-ecfa-483a-9e6a-1a36473c8a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-786772176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd70a4f1-161e-4540-a151-dede183e3242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:40Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d6a96f-1cf3-4cdd-a877-85609fe205f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d6a96f-1cf3-4cdd-a877-85609fe205f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db5b6b0-a57f-4db5-bf75-19967e1126ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db5b6b0-a57f-4db5-bf75-19967e1126ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd70a4f1-161e-4540-a151-dede183e3242', 'volume_name': 'volume-bd70a4f1-161e-4540-a151-dede183e3242', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a8daf1-8fc3-45b4-8ca0-58c151d91065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a8daf1-8fc3-45b4-8ca0-58c151d91065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959b564b-623b-4058-966b-b3b80c05d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Volume bd70a4f1-161e-4540-a151-dede183e3242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd70a4f1-161e-4540-a151-dede183e3242', 'volume_size': 1}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-786772176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd70a4f1-161e-4540-a151-dede183e3242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:40Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Creating volume bd70a4f1-161e-4540-a151-dede183e3242 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:40 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:40 devstack sudo[87629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242 1073741824
Apr 16 02:39:40 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:40 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242 1073741824" returned: 0 in 0.654s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:40 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242
Apr 16 02:39:40 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:41 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242" returned: 0 in 0.705s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959b564b-623b-4058-966b-b3b80c05d294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd70a4f1-161e-4540-a151-dede183e3242', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50195aa5-aef3-429f-8394-b79fbea02568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:41 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Volume volume-bd70a4f1-161e-4540-a151-dede183e3242 (bd70a4f1-161e-4540-a151-dede183e3242): created successfully
Apr 16 02:39:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50195aa5-aef3-429f-8394-b79fbea02568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (d9b07772-d1d7-4a96-b3c2-43c561a5936e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:41 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1708120f-759f-4b2e-8033-6a8d7602d75e tempest-VolumesActionsTest-374705788 None] Created volume successfully.
Apr 16 02:39:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-bd70a4f1-161e-4540-a151-dede183e3242-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Lock "cinder-bd70a4f1-161e-4540-a151-dede183e3242-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Acquiring lock "cinder-quobyte-bd70a4f1-161e-4540-a151-dede183e3242" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-bd70a4f1-161e-4540-a151-dede183e3242" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:42 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcc49a9-4baa-4ad7-a680-de797279b6d6]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:42 devstack sudo[87667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242
Apr 16 02:39:42 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:43 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242" returned: 0 in 1.115s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:43 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242
Apr 16 02:39:43 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e07512-9118-470a-90e1-05721fc7c276 tempest-VolumesActionsTest-768136828 None] Acquiring lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d" by "attach_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e07512-9118-470a-90e1-05721fc7c276 tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d" acquired by "attach_volume" :: waited 0.047s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-89e07512-9118-470a-90e1-05721fc7c276 tempest-VolumesActionsTest-768136828 None] Attaching volume fd7c353c-5b47-4ac2-97f6-cf174df9748d to instance 04ceb40d-f7d8-4f41-a607-adf1c39ddf9c at mountpoint /dev/vdb on host None.
Apr 16 02:39:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-89e07512-9118-470a-90e1-05721fc7c276 tempest-VolumesActionsTest-768136828 None] Attach volume completed successfully.
Apr 16 02:39:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e07512-9118-470a-90e1-05721fc7c276 tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d" released by "attach_volume" :: held 0.150s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dca28cac-f061-48e5-9c5d-35f06d507f80 tempest-VolumesActionsTest-768136828 None] Acquiring lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-detach_volume" by "detach_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dca28cac-f061-48e5-9c5d-35f06d507f80 tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:44 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-dca28cac-f061-48e5-9c5d-35f06d507f80 tempest-VolumesActionsTest-768136828 None] Detaching volume fd7c353c-5b47-4ac2-97f6-cf174df9748d from instance 04ceb40d-f7d8-4f41-a607-adf1c39ddf9c.
Apr 16 02:39:44 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-dca28cac-f061-48e5-9c5d-35f06d507f80 tempest-VolumesActionsTest-768136828 None] Detach volume completed successfully.
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dca28cac-f061-48e5-9c5d-35f06d507f80 tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:44 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bd70a4f1-161e-4540-a151-dede183e3242" returned: 0 in 1.019s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Lock "cinder-quobyte-bd70a4f1-161e-4540-a151-dede183e3242" released by "delete_volume" :: held 2.213s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Created reservations ['d67ae75f-4fef-437b-9183-736aa40a990f', '4e194525-66e7-411e-861f-0126b1ae6afd', '93991e8c-2e44-40c6-b1ce-d3cece863393', '6c567b71-84d8-4b9f-9860-79730af04ab5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:44 devstack sudo[87717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:44 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:45 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.620s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:45 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:45 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Deleted volume successfully.
Apr 16 02:39:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38b1c4bf-6595-495b-95ea-14e25fb4a33c tempest-VolumesActionsTest-890236287 None] Lock "cinder-bd70a4f1-161e-4540-a151-dede183e3242-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (72cdc28d-4f00-4c66-9bab-b2110480eac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75b973b-5033-469a-95b1-2b27387ee686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b75b973b-5033-469a-95b1-2b27387ee686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1354400922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8864146b-ba89-4724-8f41-02daaa182def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:46Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ac28a5-cdd1-4a89-a2f7-4fa0d27b3878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ac28a5-cdd1-4a89-a2f7-4fa0d27b3878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63930c0-1daa-4f4f-80aa-0e1eacab1d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63930c0-1daa-4f4f-80aa-0e1eacab1d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8864146b-ba89-4724-8f41-02daaa182def', 'volume_name': 'volume-8864146b-ba89-4724-8f41-02daaa182def', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e8ab47-4999-44cf-9dbe-a5417be39068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e8ab47-4999-44cf-9dbe-a5417be39068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5caac57-5916-424d-b1f3-503478e1f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:46 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Volume 8864146b-ba89-4724-8f41-02daaa182def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8864146b-ba89-4724-8f41-02daaa182def', 'volume_size': 1}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1354400922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8864146b-ba89-4724-8f41-02daaa182def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8010538b49f94c248a0715d6aabf2a16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:39:46Z,use_quota=True,user_id='5581530cd287413a8bec1937673edb57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Creating volume 8864146b-ba89-4724-8f41-02daaa182def {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:39:46 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:39:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:46 devstack sudo[87744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def 1073741824
Apr 16 02:39:46 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:47 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def 1073741824" returned: 0 in 0.872s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=123,cinder:UPDATE=142,cinder:INSERT=29,cinder:DELETE=12 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=104,cinder:DELETE=13,cinder:UPDATE=145,cinder:INSERT=38 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:47 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def
Apr 16 02:39:47 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:47 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def" returned: 0 in 0.520s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5caac57-5916-424d-b1f3-503478e1f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8864146b-ba89-4724-8f41-02daaa182def', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380a70e4-65ee-4066-92ee-b2b1b441fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:39:47 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Volume volume-8864146b-ba89-4724-8f41-02daaa182def (8864146b-ba89-4724-8f41-02daaa182def): created successfully
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380a70e4-65ee-4066-92ee-b2b1b441fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:39:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Flow 'volume_create_manager' (72cdc28d-4f00-4c66-9bab-b2110480eac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:39:47 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-546352ac-6b1f-4593-9c91-ca2dc806964f tempest-VolumesActionsTest-374705788 None] Created volume successfully.
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Acquiring lock "cinder-8864146b-ba89-4724-8f41-02daaa182def-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Lock "cinder-8864146b-ba89-4724-8f41-02daaa182def-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Acquiring lock "cinder-quobyte-8864146b-ba89-4724-8f41-02daaa182def" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Lock "cinder-quobyte-8864146b-ba89-4724-8f41-02daaa182def" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e43772-d41d-4fc1-b071-2c2603262397]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:49 devstack sudo[87760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def
Apr 16 02:39:49 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:49 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def" returned: 0 in 0.555s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:49 devstack sudo[87765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def
Apr 16 02:39:49 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:50 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8864146b-ba89-4724-8f41-02daaa182def" returned: 0 in 0.989s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Lock "cinder-quobyte-8864146b-ba89-4724-8f41-02daaa182def" released by "delete_volume" :: held 1.613s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Created reservations ['61541da9-d4f5-4ccb-b3e0-71be274c0927', '10e5e3b8-a968-47ae-966c-e376a404bb15', '53b20828-5963-453d-a594-bad33d476a78', '14217462-821c-4722-a956-8589673a5c0f'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:50 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:50 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:39:51 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Apr 16 02:39:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.506s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:39:51 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:39:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Deleted volume successfully.
Apr 16 02:39:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4d4cec4a-9fb5-439b-a3a8-798d0c7bc54e tempest-VolumesActionsTest-374705788 None] Lock "cinder-8864146b-ba89-4724-8f41-02daaa182def-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:39:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:39:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:39:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:39:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:39:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:39:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:39:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:39:59 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:39:59 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:00 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.869s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:40:00 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=6,cinder:INSERT=5,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:40:01 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:DELETE=1 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Flow 'volume_create_manager' (f11af8ad-2e45-4339-923f-e087493ff20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071f489a-a352-48f8-b942-b9c0b5933e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071f489a-a352-48f8-b942-b9c0b5933e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-369547506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7988fd3-03be-4d25-b532-b761216cdba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc491395d0c4096a63d49641638c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:04Z,use_quota=True,user_id='bd039610ed42412b9baa024903a318d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1995d718-140e-4988-bcae-4f8397305e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1995d718-140e-4988-bcae-4f8397305e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ccb42-647f-433c-8ff1-8d3bf54b3524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ccb42-647f-433c-8ff1-8d3bf54b3524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7988fd3-03be-4d25-b532-b761216cdba9', 'volume_name': 'volume-d7988fd3-03be-4d25-b532-b761216cdba9', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e85e054-727c-42c8-9dc8-4409c4e1b3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e85e054-727c-42c8-9dc8-4409c4e1b3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f053a03-5831-4258-8449-58e75ce1da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:04 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Volume d7988fd3-03be-4d25-b532-b761216cdba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7988fd3-03be-4d25-b532-b761216cdba9', 'volume_size': 1}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-369547506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7988fd3-03be-4d25-b532-b761216cdba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc491395d0c4096a63d49641638c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:04Z,use_quota=True,user_id='bd039610ed42412b9baa024903a318d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Creating volume d7988fd3-03be-4d25-b532-b761216cdba9 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:04 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:04 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9 1073741824
Apr 16 02:40:04 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:04 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9 1073741824" returned: 0 in 0.663s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:05 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9
Apr 16 02:40:05 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:06 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9" returned: 0 in 1.792s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] <== create_volume: return (2498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f053a03-5831-4258-8449-58e75ce1da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7988fd3-03be-4d25-b532-b761216cdba9', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b48ccf-f4d2-4bd4-9b9b-7e5ae4d539f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:06 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Volume volume-d7988fd3-03be-4d25-b532-b761216cdba9 (d7988fd3-03be-4d25-b532-b761216cdba9): created successfully
Apr 16 02:40:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b48ccf-f4d2-4bd4-9b9b-7e5ae4d539f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Flow 'volume_create_manager' (f11af8ad-2e45-4339-923f-e087493ff20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e9c0fc90-9524-4b8e-9425-0053eb6f500a tempest-VolumesListAdminTestJSON-159581617 None] Created volume successfully.
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Flow 'volume_create_manager' (4cfee184-ca8e-48c5-aec4-7691d10fc7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a9bbd3-e476-4648-9919-ac2d56c881d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a9bbd3-e476-4648-9919-ac2d56c881d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:08Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65587b1f-283b-4f22-8479-48d63050e772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033117d90ee847b7b96237c8f43af56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:08Z,use_quota=True,user_id='e71e2f0a0eb3459cb5d208358fcdb33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e2e435-4820-4b3c-8e97-49c9c9f759a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e2e435-4820-4b3c-8e97-49c9c9f759a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0160249c-8592-4c76-8083-ff1dcfcc47bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.image.glance [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Creating Keystone auth plugin from conf {{(pid=83205) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Acquiring lock "cinder-e58c3218-8730-44e7-a7f9-d53b03e6165e-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Flow 'volume_create_manager' (9709f23e-fece-4b13-abbe-f0c1ad4f921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a34b26c-b935-43df-8724-a1a3e7a68966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a34b26c-b935-43df-8724-a1a3e7a68966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-680346589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7749b128-9975-49c6-ba0e-1eb2f53e87ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc491395d0c4096a63d49641638c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:09Z,use_quota=True,user_id='bd039610ed42412b9baa024903a318d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6779c0ff-1875-49a4-a1d9-6da195eb4b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6779c0ff-1875-49a4-a1d9-6da195eb4b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f6490e-0e5d-4864-b339-06b0d464b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f6490e-0e5d-4864-b339-06b0d464b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7749b128-9975-49c6-ba0e-1eb2f53e87ed', 'volume_name': 'volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a844c34-cc7c-4d26-938b-ba0c2b9ba092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a844c34-cc7c-4d26-938b-ba0c2b9ba092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12897d46-43f0-4149-978a-439f00187072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:08 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Volume 7749b128-9975-49c6-ba0e-1eb2f53e87ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed', 'volume_size': 1}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-680346589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7749b128-9975-49c6-ba0e-1eb2f53e87ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc491395d0c4096a63d49641638c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:09Z,use_quota=True,user_id='bd039610ed42412b9baa024903a318d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Creating volume 7749b128-9975-49c6-ba0e-1eb2f53e87ed {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:08 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c6235cd6-d9cb-4b67-9ef5-da31a74251df tempest-VolumesActionsTest-768136828 None] Acquiring lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d" by "attach_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:08 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed 1073741824
Apr 16 02:40:08 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c6235cd6-d9cb-4b67-9ef5-da31a74251df tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d" acquired by "attach_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Lock "cinder-e58c3218-8730-44e7-a7f9-d53b03e6165e-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Acquiring lock "cinder-quobyte-e58c3218-8730-44e7-a7f9-d53b03e6165e" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Lock "cinder-quobyte-e58c3218-8730-44e7-a7f9-d53b03e6165e" acquired by "delete_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c6235cd6-d9cb-4b67-9ef5-da31a74251df tempest-VolumesActionsTest-768136828 None] Attaching volume fd7c353c-5b47-4ac2-97f6-cf174df9748d to instance 02a98f8a-0bf3-40d1-b2c1-9f8aca63791f at mountpoint /dev/vdb on host None.
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1d49da-6e44-41a0-9027-5a1fdff416bd]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c6235cd6-d9cb-4b67-9ef5-da31a74251df tempest-VolumesActionsTest-768136828 None] Attach volume completed successfully.
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c6235cd6-d9cb-4b67-9ef5-da31a74251df tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d" released by "attach_volume" :: held 0.138s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:09 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e
Apr 16 02:40:09 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0160249c-8592-4c76-8083-ff1dcfcc47bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65587b1f-283b-4f22-8479-48d63050e772', 'volume_name': 'volume-65587b1f-283b-4f22-8479-48d63050e772', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d00b94b20>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cda97ad-165b-421a-ba06-58968157b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cda97ad-165b-421a-ba06-58968157b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea59e12-707a-4f32-9968-38bed278f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:09 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Volume 65587b1f-283b-4f22-8479-48d63050e772: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65587b1f-283b-4f22-8479-48d63050e772', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d00b94b20>}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Trying to clone 65587b1f-283b-4f22-8479-48d63050e772 from image e278c10c-b2af-4a05-aacb-8b1a6716d838 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]). {{(pid=83205) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 02:40:09 devstack cinder-volume[83205]: INFO cinder.image.image_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f802a4d-ec2e-45c7-a566-ac4cb784ecc4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3c360354-f798-4c1f-9673-d7fb7a2f8dcb tempest-VolumesActionsTest-768136828 None] Acquiring lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-detach_volume" by "detach_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3c360354-f798-4c1f-9673-d7fb7a2f8dcb tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3c360354-f798-4c1f-9673-d7fb7a2f8dcb tempest-VolumesActionsTest-768136828 None] Detaching volume fd7c353c-5b47-4ac2-97f6-cf174df9748d from instance 02a98f8a-0bf3-40d1-b2c1-9f8aca63791f.
Apr 16 02:40:09 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD
Apr 16 02:40:09 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3c360354-f798-4c1f-9673-d7fb7a2f8dcb tempest-VolumesActionsTest-768136828 None] Detach volume completed successfully.
Apr 16 02:40:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3c360354-f798-4c1f-9673-d7fb7a2f8dcb tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:10 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed 1073741824" returned: 0 in 1.073s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:10 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed
Apr 16 02:40:10 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:10 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e" returned: 0 in 1.380s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:10 devstack sudo[88060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e
Apr 16 02:40:10 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:10 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD" returned: 0 in 1.092s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 is fetched for user e71e2f0a0eb3459cb5d208358fcdb33e. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f6f675-a8f4-4748-8cd8-85435282170a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:10 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD
Apr 16 02:40:10 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:11 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed" returned: 0 in 1.116s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12897d46-43f0-4149-978a-439f00187072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae64d1f-c15e-4a80-9eee-c38f5a4ff116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Volume volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed (7749b128-9975-49c6-ba0e-1eb2f53e87ed): created successfully
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae64d1f-c15e-4a80-9eee-c38f5a4ff116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Flow 'volume_create_manager' (9709f23e-fece-4b13-abbe-f0c1ad4f921b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:11 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-18b7cee1-19b3-4b7f-beb8-ff110970b407 tempest-VolumesListAdminTestJSON-159581617 None] Created volume successfully.
Apr 16 02:40:11 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e58c3218-8730-44e7-a7f9-d53b03e6165e" returned: 0 in 0.899s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Lock "cinder-quobyte-e58c3218-8730-44e7-a7f9-d53b03e6165e" released by "delete_volume" :: held 2.349s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Created reservations ['9ff6832d-5529-4c79-9174-ac343e91bee1', '3545bd15-51cb-439a-851c-fbb7e695ed6e', 'bbc7c233-60ef-498f-b918-e268318ab766', '94d8b370-16c0-4420-8266-6b7d6695d632'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:11 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:40:11 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:11 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD" returned: 0 in 0.852s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:08Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65587b1f-283b-4f22-8479-48d63050e772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033117d90ee847b7b96237c8f43af56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:08Z,use_quota=True,user_id='e71e2f0a0eb3459cb5d208358fcdb33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Creating volume 65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:11 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:11 devstack sudo[88077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 1073741824
Apr 16 02:40:11 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:12 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.906s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:12 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:40:12 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Deleted volume successfully.
Apr 16 02:40:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ffc73579-bb26-4479-8b8c-d6e53f9720f1 tempest-VolumesNegativeTest-250134586 None] Lock "cinder-e58c3218-8730-44e7-a7f9-d53b03e6165e-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:12 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 1073741824" returned: 0 in 1.251s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:12 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:40:12 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:12 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Flow 'volume_create_manager' (b5bc027c-61a9-4797-900c-360f38d5dfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f934c3f-0651-492f-8f4b-3634ea8a8910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f934c3f-0651-492f-8f4b-3634ea8a8910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1844636312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbae173-d1fe-4d37-ada5-3f610da5edd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc491395d0c4096a63d49641638c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:13Z,use_quota=True,user_id='bd039610ed42412b9baa024903a318d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9fe122-46b0-4274-961f-37bb216330a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9fe122-46b0-4274-961f-37bb216330a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df490113-c86b-440d-8a45-5c0456e38c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df490113-c86b-440d-8a45-5c0456e38c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dbae173-d1fe-4d37-ada5-3f610da5edd7', 'volume_name': 'volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e02dfd-9372-4512-86f2-b4bd912f0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e02dfd-9372-4512-86f2-b4bd912f0304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0477d4-75de-4042-b07a-803384da4eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:13 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Volume 6dbae173-d1fe-4d37-ada5-3f610da5edd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7', 'volume_size': 1}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:13 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 0 in 0.483s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.270s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1844636312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbae173-d1fe-4d37-ada5-3f610da5edd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc491395d0c4096a63d49641638c6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:13Z,use_quota=True,user_id='bd039610ed42412b9baa024903a318d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Creating volume 6dbae173-d1fe-4d37-ada5-3f610da5edd7 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:13 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Attempting download of e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume 65587b1f-283b-4f22-8479-48d63050e772. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 02:40:13 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7 1073741824
Apr 16 02:40:13 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c10a45-ee17-46d7-917a-2bd9b1db8646]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_179v5de0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:13 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_179v5de0
Apr 16 02:40:13 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:14 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7 1073741824" returned: 0 in 0.820s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:14 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_179v5de0" returned: 0 in 0.712s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_179v5de0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:14 devstack sudo[88118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7
Apr 16 02:40:14 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:14 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_179v5de0
Apr 16 02:40:14 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Flow 'volume_create_manager' (09dbe2ca-4474-4a23-bed1-5ab441235c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414a1aab-4755-442e-9991-8aa7a02ec1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414a1aab-4755-442e-9991-8aa7a02ec1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-931996330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a249936b-eb44-4693-949c-a815e42c08ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b009e258ad546688a103ea1e928160f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:15Z,use_quota=True,user_id='07f718bb511344f7be1cf3ab89f8c2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2090ded5-aff1-49d8-b341-fcfa359a2eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2090ded5-aff1-49d8-b341-fcfa359a2eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a32626-9efd-428c-b276-9d5e9a75b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a32626-9efd-428c-b276-9d5e9a75b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a249936b-eb44-4693-949c-a815e42c08ce', 'volume_name': 'volume-a249936b-eb44-4693-949c-a815e42c08ce', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10815681-2dd3-4e93-b2d1-fa6d1095e28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10815681-2dd3-4e93-b2d1-fa6d1095e28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a3a0cc-a5b9-4861-9a46-257506d29fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Volume a249936b-eb44-4693-949c-a815e42c08ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a249936b-eb44-4693-949c-a815e42c08ce', 'volume_size': 1}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:14 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7" returned: 0 in 0.546s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-931996330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a249936b-eb44-4693-949c-a815e42c08ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b009e258ad546688a103ea1e928160f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:15Z,use_quota=True,user_id='07f718bb511344f7be1cf3ab89f8c2a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Creating volume a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:14 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0477d4-75de-4042-b07a-803384da4eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:14 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce 1073741824
Apr 16 02:40:14 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1ca2a3-37ce-45e5-8f22-973abe29f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Volume volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7 (6dbae173-d1fe-4d37-ada5-3f610da5edd7): created successfully
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1ca2a3-37ce-45e5-8f22-973abe29f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Flow 'volume_create_manager' (b5bc027c-61a9-4797-900c-360f38d5dfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:14 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-db60c0cf-2c39-4254-9aa5-2177cfcebebf tempest-VolumesListAdminTestJSON-159581617 None] Created volume successfully.
Apr 16 02:40:14 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_179v5de0" returned: 1 in 0.686s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_179v5de0' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c817ca-f3b3-4b47-8ab4-d35d8896a4d1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:15 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD
Apr 16 02:40:15 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:15 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce 1073741824" returned: 0 in 0.849s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:15 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce
Apr 16 02:40:15 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:15 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD" returned: 0 in 0.856s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:15 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] e278c10c-b2af-4a05-aacb-8b1a6716d838 was qcow2, converting to raw {{(pid=83205) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 02:40:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:15 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:40:15 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Flow 'volume_create_manager' (b8dbb50a-81f3-4329-874c-29c6d1943108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6315856f-0ef0-4c7f-9b52-d383ae5b678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6315856f-0ef0-4c7f-9b52-d383ae5b678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520796b4-75dd-49f8-98cb-cf6c02a51ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e358008b6ff4d62add51661a8b43cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:16Z,use_quota=True,user_id='cf8d045c0ebc4183b937b98e5126164e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56920795-b2e5-47ac-8cd0-68ba58aac784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56920795-b2e5-47ac-8cd0-68ba58aac784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f85342-1f93-4e2d-bdad-2ec39cea3411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f85342-1f93-4e2d-bdad-2ec39cea3411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520796b4-75dd-49f8-98cb-cf6c02a51ba3', 'volume_name': 'volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ba591-ec1b-4f11-bdd9-edc60ba235ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ba591-ec1b-4f11-bdd9-edc60ba235ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e053c77e-033a-4336-b9b7-8b3f491f1c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:16 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Volume 520796b4-75dd-49f8-98cb-cf6c02a51ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3', 'volume_size': 1}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:16 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce" returned: 0 in 0.529s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=520796b4-75dd-49f8-98cb-cf6c02a51ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e358008b6ff4d62add51661a8b43cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:16Z,use_quota=True,user_id='cf8d045c0ebc4183b937b98e5126164e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Creating volume 520796b4-75dd-49f8-98cb-cf6c02a51ba3 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:16 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a3a0cc-a5b9-4861-9a46-257506d29fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a249936b-eb44-4693-949c-a815e42c08ce', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:16 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3 1073741824
Apr 16 02:40:16 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3883e37-1bd3-4ec0-8368-12bcd73f0621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:16 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Volume volume-a249936b-eb44-4693-949c-a815e42c08ce (a249936b-eb44-4693-949c-a815e42c08ce): created successfully
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3883e37-1bd3-4ec0-8368-12bcd73f0621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Flow 'volume_create_manager' (09dbe2ca-4474-4a23-bed1-5ab441235c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2eb29ab2-615f-47d0-aace-60455aff59b1 tempest-VolumesSnapshotListTestJSON-3423642 None] Created volume successfully.
Apr 16 02:40:16 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 0 in 1.184s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_4n4ci2r3devstack@QuobyteHD, size 112.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:40:16 devstack cinder-volume[83205]: INFO cinder.image.image_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Converted 112.00 MB image at 94.47 MB/s
Apr 16 02:40:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:17 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 1G
Apr 16 02:40:17 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:17 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3 1073741824" returned: 0 in 0.812s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:17 devstack sudo[88163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3
Apr 16 02:40:17 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:17 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 1G" returned: 0 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[df27066c-3f4f-46e1-8d69-d22418d18fc6]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:17 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:17 devstack sudo[88169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:40:17 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.470s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Creating offline snapshot 49e2d444-0218-41c1-a867-886612386f22 of volume a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e053c77e-033a-4336-b9b7-8b3f491f1c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598dac15-20b0-4ff5-a0ec-35e90624b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44f2db-9343-46b5-a084-3a33b0441944]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:17 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Volume volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3 (520796b4-75dd-49f8-98cb-cf6c02a51ba3): created successfully
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598dac15-20b0-4ff5-a0ec-35e90624b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Flow 'volume_create_manager' (b8dbb50a-81f3-4329-874c-29c6d1943108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:17 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-57026afb-83fc-4b9a-b6b0-90950f5cb7ae tempest-VolumesListAdminTestJSON-615673973 None] Created volume successfully.
Apr 16 02:40:17 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce
Apr 16 02:40:17 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:18 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 0 in 0.657s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:18 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:40:18 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Acquiring lock "cinder-520796b4-75dd-49f8-98cb-cf6c02a51ba3-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Lock "cinder-520796b4-75dd-49f8-98cb-cf6c02a51ba3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Acquiring lock "cinder-quobyte-520796b4-75dd-49f8-98cb-cf6c02a51ba3" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Lock "cinder-quobyte-520796b4-75dd-49f8-98cb-cf6c02a51ba3" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:18 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce" returned: 0 in 0.788s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4277cf-a40a-4c50-bfb8-8c38d2c84a48]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "cinder-6dbae173-d1fe-4d37-ada5-3f610da5edd7-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:18 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 1G
Apr 16 02:40:18 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-6dbae173-d1fe-4d37-ada5-3f610da5edd7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "cinder-quobyte-6dbae173-d1fe-4d37-ada5-3f610da5edd7" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-quobyte-6dbae173-d1fe-4d37-ada5-3f610da5edd7" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e19a8-2138-4af3-9063-41f5b438b097]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:18 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3
Apr 16 02:40:18 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:18 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7
Apr 16 02:40:18 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:19 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3" returned: 0 in 0.601s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:19 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:19 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3
Apr 16 02:40:19 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 1 in 0.937s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Downloaded image e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume 65587b1f-283b-4f22-8479-48d63050e772 successfully. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 for user e71e2f0a0eb3459cb5d208358fcdb33e is deleted. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Marking volume 65587b1f-283b-4f22-8479-48d63050e772 as bootable. {{(pid=83205) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Copying metadata from image e278c10c-b2af-4a05-aacb-8b1a6716d838 to 65587b1f-283b-4f22-8479-48d63050e772. {{(pid=83205) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Creating volume glance metadata for volume 65587b1f-283b-4f22-8479-48d63050e772 backed by image e278c10c-b2af-4a05-aacb-8b1a6716d838 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83205) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea59e12-707a-4f32-9968-38bed278f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65587b1f-283b-4f22-8479-48d63050e772', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d00b94b20>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc9bbdd-265f-4820-b7c7-e7d80cb15abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:19 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Volume volume-65587b1f-283b-4f22-8479-48d63050e772 (65587b1f-283b-4f22-8479-48d63050e772): created successfully
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc9bbdd-265f-4820-b7c7-e7d80cb15abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Flow 'volume_create_manager' (4cfee184-ca8e-48c5-aec4-7691d10fc7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:19 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-45364606-176f-4587-8d1a-db6d72b9f699 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Created volume successfully.
Apr 16 02:40:19 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 1G" returned: 0 in 0.973s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:19 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22
Apr 16 02:40:19 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:19 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7" returned: 0 in 0.934s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:19 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7
Apr 16 02:40:19 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:19 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-520796b4-75dd-49f8-98cb-cf6c02a51ba3" returned: 0 in 0.618s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Lock "cinder-quobyte-520796b4-75dd-49f8-98cb-cf6c02a51ba3" released by "delete_volume" :: held 1.272s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Created reservations ['b81f0c20-9c0e-4880-9cb9-82022aff1d25', '40e891f5-3b1f-4b6e-ab50-27fa9aa4a68c', '13ba4573-e580-43a6-a4ba-d72a0febb8d9', '5aca11aa-f644-448b-a639-306cacd33adf'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:19 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:40:19 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:19 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:19 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 is being set with open permissions: ugo+rw
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:19 devstack sudo[88211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22
Apr 16 02:40:19 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:19 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6dbae173-d1fe-4d37-ada5-3f610da5edd7" returned: 0 in 0.412s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-quobyte-6dbae173-d1fe-4d37-ada5-3f610da5edd7" released by "delete_volume" :: held 1.372s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:19 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Created reservations ['49a36057-780d-4c04-b6bf-4182ed60706c', '22bf4111-ea7f-4de0-a121-3781eefdcaf2', '12a50141-ea84-46a6-a117-f1d892dc54c9', 'b3da5f94-1df9-4067-bd48-28254aaa7b3c'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:20 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:40:20 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:20 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:40:20 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Deleted volume successfully.
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f878cb34-b66c-43c2-bcaf-ee2a3c829d76 tempest-VolumesListAdminTestJSON-615673973 None] Lock "cinder-520796b4-75dd-49f8-98cb-cf6c02a51ba3-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:20 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22" returned: 0 in 0.486s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:20 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.info
Apr 16 02:40:20 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:20 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.483s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:40:20 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Deleted volume successfully.
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b9c08cb0-9281-48e8-8974-6311ab10eb28 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-6dbae173-d1fe-4d37-ada5-3f610da5edd7-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "cinder-7749b128-9975-49c6-ba0e-1eb2f53e87ed-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-7749b128-9975-49c6-ba0e-1eb2f53e87ed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "cinder-quobyte-7749b128-9975-49c6-ba0e-1eb2f53e87ed" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-quobyte-7749b128-9975-49c6-ba0e-1eb2f53e87ed" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb7562d-8bab-4420-9969-0745996c82a1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:20 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed
Apr 16 02:40:20 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:20 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.info" returned: 0 in 0.536s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:20 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.info is being set with open permissions: ugo+rw
Apr 16 02:40:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:20 devstack sudo[88227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.info
Apr 16 02:40:20 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:21 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed" returned: 0 in 0.536s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:21 devstack sudo[88239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed
Apr 16 02:40:21 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:21 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.info" returned: 0 in 0.449s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.833s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.100s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac84a2c-b20a-4d08-9568-c511de00f4d7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ffa5d681-3493-49b7-8644-0514900e1bee tempest-VolumesSnapshotListTestJSON-3423642 None] Create snapshot completed successfully
Apr 16 02:40:21 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:21 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:21 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7749b128-9975-49c6-ba0e-1eb2f53e87ed" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-quobyte-7749b128-9975-49c6-ba0e-1eb2f53e87ed" released by "delete_volume" :: held 1.062s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Created reservations ['c90ef2b6-1e83-4750-a715-818805cf7673', 'c61592c5-2efc-46bb-bf1b-6507ddb30b0e', 'bbe73a3c-a52d-43e4-8776-ec18b7b8317a', '29489c29-101c-44f7-b4dc-132702c91db8'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:21 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:21 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:40:21 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.525s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567ccae-a6aa-44bf-8d6b-44ab107d6e79]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:22 devstack sudo[88249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:22 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:22 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.429s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:22 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:40:22 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Deleted volume successfully.
Apr 16 02:40:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b12af119-1675-4eac-ad23-192c3f662502 tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-7749b128-9975-49c6-ba0e-1eb2f53e87ed-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:22 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.490s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.a57ffaca-c425-4c3e-9de1-757317e8f503n6jz250_.img {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:22 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.a57ffaca-c425-4c3e-9de1-757317e8f503n6jz250_.img
Apr 16 02:40:22 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "cinder-d7988fd3-03be-4d25-b532-b761216cdba9-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-d7988fd3-03be-4d25-b532-b761216cdba9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "cinder-quobyte-d7988fd3-03be-4d25-b532-b761216cdba9" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-quobyte-d7988fd3-03be-4d25-b532-b761216cdba9" acquired by "delete_volume" :: waited 0.030s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:23 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8448ab-f282-488a-8c83-6fd775bf0424]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:23 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9
Apr 16 02:40:23 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:24 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9" returned: 0 in 0.752s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:24 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9
Apr 16 02:40:24 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:24 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d7988fd3-03be-4d25-b532-b761216cdba9" returned: 0 in 0.777s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-quobyte-d7988fd3-03be-4d25-b532-b761216cdba9" released by "delete_volume" :: held 1.579s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Created reservations ['2af4876f-612b-4b37-9620-e38c4c3527d2', '0a9aa9c5-85b8-4049-a859-e7a0739b2c50', 'b4dad1f9-cd20-406e-b9aa-71824032cea2', 'bbe16847-a075-45a9-b439-029d8a38a2ee'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:24 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.a57ffaca-c425-4c3e-9de1-757317e8f503n6jz250_.img" returned: 0 in 2.467s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[40530a85-158a-46b3-9715-eba2661ddec5]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:24 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:40:24 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:24 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:24 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:25 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.418s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:25 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:40:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Deleted volume successfully.
Apr 16 02:40:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-81bb5318-9cc5-4b7d-9f90-7487288db4db tempest-VolumesListAdminTestJSON-159581617 None] Lock "cinder-d7988fd3-03be-4d25-b532-b761216cdba9-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:25 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.666s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:25 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.a57ffaca-c425-4c3e-9de1-757317e8f503n6jz250_.img {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:40:25 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Converted 1024.00 MB image at 414.87 MB/s
Apr 16 02:40:25 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] a57ffaca-c425-4c3e-9de1-757317e8f503 was raw, no need to convert to raw {{(pid=83205) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Flow 'volume_create_manager' (d75e4b97-9345-48b1-b006-0b16f0543d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd2f25-a210-4955-8858-2ac492bd09e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd2f25-a210-4955-8858-2ac492bd09e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1680829449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21611211-95c8-4975-b81b-f3b0528e7884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab1a91395554e21a67461fcd85b4a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:31Z,use_quota=True,user_id='8ed6c0de370c4745ada0999159659f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64db0864-d545-4339-995e-71a3dc31b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64db0864-d545-4339-995e-71a3dc31b652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a808f80f-7904-4217-b8f9-40046f6a2080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a808f80f-7904-4217-b8f9-40046f6a2080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21611211-95c8-4975-b81b-f3b0528e7884', 'volume_name': 'volume-21611211-95c8-4975-b81b-f3b0528e7884', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45be57c-dd4b-4285-959c-678d391888c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45be57c-dd4b-4285-959c-678d391888c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda05466-2419-468f-a9e3-b6bd6be67d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:30 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Volume 21611211-95c8-4975-b81b-f3b0528e7884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21611211-95c8-4975-b81b-f3b0528e7884', 'volume_size': 1}
Apr 16 02:40:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.798s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Uploaded volume to glance image-id: a57ffaca-c425-4c3e-9de1-757317e8f503. {{(pid=83205) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 16 02:40:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.135s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:36 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e1bc96f0-794f-410b-a4a1-fe0e3087d8c8 tempest-VolumesActionsTest-768136828 None] Copy volume to image completed successfully.
Apr 16 02:40:36 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05869d6-0453-44e3-bb32-1a37faef871f]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:36 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:40:36 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:36 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 0 in 0.498s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:36 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:40:36 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:37 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 1 in 0.545s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.077s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.814s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Creating offline snapshot e2ef6514-6384-4357-965b-5faf6376cc69 of volume a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e38d54-7f71-4e82-a1f0-540e2f3f941a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5', 'name': 'volume-65587b1f-283b-4f22-8479-48d63050e772', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7b379c9-1060-493e-9ef3-e0cc56782662', 'enforce_multipath': True} {{(pid=83205) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:37 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22
Apr 16 02:40:37 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-c5595049-d7f5-4317-83df-3b30c69fae81 req-eb08bae6-8a6d-4b78-834b-3248287aa7e4 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] attachment_update completed successfully.
Apr 16 02:40:37 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22" returned: 0 in 0.534s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a249936b-eb44-4693-949c-a815e42c08ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:37 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 1G
Apr 16 02:40:37 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:38 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 1G" returned: 0 in 0.498s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:38 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69
Apr 16 02:40:38 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:38 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:38 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 is being set with open permissions: ugo+rw
Apr 16 02:40:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:38 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69
Apr 16 02:40:38 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:39 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69" returned: 0 in 0.432s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.528s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1680829449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21611211-95c8-4975-b81b-f3b0528e7884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab1a91395554e21a67461fcd85b4a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:31Z,use_quota=True,user_id='8ed6c0de370c4745ada0999159659f2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Creating volume 21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:39 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:39 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 1073741824
Apr 16 02:40:39 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-853fee18-8fd1-4270-97c8-4849ff8fe8af tempest-VolumesSnapshotListTestJSON-3423642 None] Create snapshot completed successfully
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:39 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 1073741824" returned: 0 in 0.574s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:39 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884
Apr 16 02:40:39 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:40 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.940s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda05466-2419-468f-a9e3-b6bd6be67d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21611211-95c8-4975-b81b-f3b0528e7884', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b4a0d9-2a83-4eda-b0a8-0fd3eb4208dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[de920844-eb62-4e28-b894-7da525935134]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Volume volume-21611211-95c8-4975-b81b-f3b0528e7884 (21611211-95c8-4975-b81b-f3b0528e7884): created successfully
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b4a0d9-2a83-4eda-b0a8-0fd3eb4208dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Flow 'volume_create_manager' (d75e4b97-9345-48b1-b006-0b16f0543d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:40 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-6c98c67b-77fa-4343-a944-b605ba2e8d5b tempest-SnapshotMetadataTestJSON-2036542063 None] Created volume successfully.
Apr 16 02:40:40 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:40 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:40 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.552s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d75219-2a66-4404-a5d3-ca7e6d0024cb]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:41 devstack sudo[88331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:41 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:41 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:41 devstack sudo[88336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img
Apr 16 02:40:41 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:44 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img" returned: 0 in 3.359s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:44 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee30c6e-bd04-4978-8438-cc659afe4edc]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:44 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:44 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:45 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.765s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:45 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d, size 1024.00 MB, duration 3.36 sec, destination /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:40:45 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Converted 1024.00 MB image at 304.75 MB/s
Apr 16 02:40:45 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] 51c00c55-2cc3-47e3-b468-bbf13784f6c6 was raw, converting to qcow2 {{(pid=83205) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 16 02:40:45 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2083d960-ccca-4d79-ab13-232b7dadda7a]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:45 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img
Apr 16 02:40:45 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:46 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img" returned: 0 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:46 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img
Apr 16 02:40:46 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:46 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img" returned: 1 in 0.552s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:40:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img /opt/stack/data/cinder/conversion/vol_upload_lweowgup {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:46 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img /opt/stack/data/cinder/conversion/vol_upload_lweowgup
Apr 16 02:40:46 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:47 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img /opt/stack/data/cinder/conversion/vol_upload_lweowgup" returned: 0 in 0.506s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:47 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Image conversion details: src /opt/stack/data/cinder/conversion/fd7c353c-5b47-4ac2-97f6-cf174df9748d.temp_image.51c00c55-2cc3-47e3-b468-bbf13784f6c6b90uh5bo.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lweowgup {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:40:47 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 16 02:40:47 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57c9b5f-dd71-4213-b5cb-69993aae7bb7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lweowgup {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:47 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lweowgup
Apr 16 02:40:47 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:47 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lweowgup" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.290s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Uploaded volume to glance image-id: 51c00c55-2cc3-47e3-b468-bbf13784f6c6. {{(pid=83205) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 16 02:40:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.960s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Creating offline snapshot ba413341-994a-4bf0-b174-f582fc2a0b69 of volume a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:40:48 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[869030b3-a3b1-4457-a05c-4863175c5d10]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:48 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-23c35411-aec8-45a2-86ea-bfe95cd0f655 tempest-VolumesActionsTest-768136828 None] Copy volume to image completed successfully.
Apr 16 02:40:48 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69
Apr 16 02:40:48 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:49 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69" returned: 0 in 0.747s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a249936b-eb44-4693-949c-a815e42c08ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:49 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 1G
Apr 16 02:40:49 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Acquiring lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Acquiring lock "cinder-quobyte-fd7c353c-5b47-4ac2-97f6-cf174df9748d" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Lock "cinder-quobyte-fd7c353c-5b47-4ac2-97f6-cf174df9748d" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a068e77-0728-4743-9c61-4d35f48316cc]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:49 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:49 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:49 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 1G" returned: 0 in 0.566s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:50 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69
Apr 16 02:40:50 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:50 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.505s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:50 devstack sudo[88445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d
Apr 16 02:40:50 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:50 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69" returned: 0 in 0.575s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:50 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 is being set with open permissions: ugo+rw
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:50 devstack sudo[88451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69
Apr 16 02:40:50 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:50 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fd7c353c-5b47-4ac2-97f6-cf174df9748d" returned: 0 in 0.506s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Lock "cinder-quobyte-fd7c353c-5b47-4ac2-97f6-cf174df9748d" released by "delete_volume" :: held 1.038s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Created reservations ['089c9f4e-466f-4a0a-b6f8-92f9fc3146e5', 'b04379b1-158c-469f-aa20-9b0491250821', 'c3cdecbb-d5e3-4185-9395-38095088e1d0', '90cbd990-f647-4f98-9056-ea60917e94b1'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:50 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:40:50 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:51 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69" returned: 0 in 0.489s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.305s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Creating offline snapshot 6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 of volume 21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:40:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-89f3ed40-5f74-4f65-947b-e9057a61688b tempest-VolumesSnapshotListTestJSON-3423642 None] Create snapshot completed successfully
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b861ace6-1e92-4e3a-ace6-29261d136fec]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:51 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884
Apr 16 02:40:51 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:51 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.480s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:40:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Deleted volume successfully.
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef5ddee7-de7f-4383-8e9c-ce6db683d617 tempest-VolumesActionsTest-768136828 None] Lock "cinder-fd7c353c-5b47-4ac2-97f6-cf174df9748d-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:51 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884" returned: 0 in 0.588s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:51 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 1G
Apr 16 02:40:51 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-ba413341-994a-4bf0-b174-f582fc2a0b69-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-ba413341-994a-4bf0-b174-f582fc2a0b69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-quobyte-ba413341-994a-4bf0-b174-f582fc2a0b69" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-ba413341-994a-4bf0-b174-f582fc2a0b69" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Deleting offline snapshot ba413341-994a-4bf0-b174-f582fc2a0b69 of volume a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] snapshot_file for this snap is: volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18b8aa8-e5a0-495e-a99c-9e7056bd97ec]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:51 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69
Apr 16 02:40:51 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:52 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 1G" returned: 0 in 0.611s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21611211-95c8-4975-b81b-f3b0528e7884 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:52 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21611211-95c8-4975-b81b-f3b0528e7884 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886
Apr 16 02:40:52 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:52 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69" returned: 0 in 0.634s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a249936b-eb44-4693-949c-a815e42c08ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7857cd8f-68f2-49bf-8da8-c090a993c564]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:52 devstack sudo[88500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69
Apr 16 02:40:52 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:52 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21611211-95c8-4975-b81b-f3b0528e7884 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" returned: 0 in 0.549s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:52 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 is being set with open permissions: ugo+rw
Apr 16 02:40:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:52 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886
Apr 16 02:40:52 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:53 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69" returned: 0 in 0.641s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a249936b-eb44-4693-949c-a815e42c08ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:53 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69
Apr 16 02:40:53 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:53 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" returned: 0 in 0.541s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:53 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.info
Apr 16 02:40:53 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:53 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69" returned: 0 in 0.620s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:53 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69
Apr 16 02:40:53 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:53 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.info" returned: 0 in 0.561s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:54 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.info is being set with open permissions: ugo+rw
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:54 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.info
Apr 16 02:40:54 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:54 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.ba413341-994a-4bf0-b174-f582fc2a0b69" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-ba413341-994a-4bf0-b174-f582fc2a0b69" released by "_delete_snapshot" :: held 2.440s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" released by "delete_snapshot" :: held 2.455s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Created reservations ['2875014f-171f-4156-99e4-49fc17794215', '7c55cf98-6613-4b5b-8dd1-7d5a599cbd5c', '7e6e3f37-a211-4ca8-aee9-9e95ad4e0860', '239e312c-d66a-4ff5-a337-3df0f5dfa416'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:54 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Delete snapshot completed successfully.
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49b7a973-624b-48b8-85a8-a8a520eda5bb tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-ba413341-994a-4bf0-b174-f582fc2a0b69-delete_snapshot" released by "delete_snapshot" :: held 2.555s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:54 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.info" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.427s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:54 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3d8ce44c-563d-43f4-bcf3-d5ee62931a95 tempest-SnapshotMetadataTestJSON-2036542063 None] Create snapshot completed successfully
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-e2ef6514-6384-4357-965b-5faf6376cc69-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-e2ef6514-6384-4357-965b-5faf6376cc69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-quobyte-e2ef6514-6384-4357-965b-5faf6376cc69" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-e2ef6514-6384-4357-965b-5faf6376cc69" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Deleting offline snapshot e2ef6514-6384-4357-965b-5faf6376cc69 of volume a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] snapshot_file for this snap is: volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1e1a65-03b9-41b5-b8bc-9c406c33b248]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:55 devstack sudo[88529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69
Apr 16 02:40:55 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:55 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69" returned: 0 in 0.750s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a249936b-eb44-4693-949c-a815e42c08ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be9681-9245-4608-9e5b-06518006bfb8]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:56 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22
Apr 16 02:40:56 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "cinder-6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "cinder-quobyte-21611211-95c8-4975-b81b-f3b0528e7884" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-quobyte-21611211-95c8-4975-b81b-f3b0528e7884" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "cinder-quobyte-6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-quobyte-6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Deleting offline snapshot 6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 of volume 21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] snapshot_file for this snap is: volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[329931e6-5938-4c9a-af8f-f50b221a50bb]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:56 devstack sudo[88563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886
Apr 16 02:40:56 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Flow 'volume_create_manager' (a6aee18a-d178-4dc6-b5a6-47cf5d192afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3de174-35e1-4294-b7d3-3b9de04a5a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3de174-35e1-4294-b7d3-3b9de04a5a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-893604467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc5011b-b7e7-4501-885a-8fb0e14c6a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80251add718b40a1a37b4a4332ec009e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:57Z,use_quota=True,user_id='0d1ed02d4fa34de2af77d9e2bf8620fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291f0fbe-1f4c-4014-a7b5-076cc27fa70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291f0fbe-1f4c-4014-a7b5-076cc27fa70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af52c2b8-2a10-4907-a095-ce7bcfd0c92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af52c2b8-2a10-4907-a095-ce7bcfd0c92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc5011b-b7e7-4501-885a-8fb0e14c6a39', 'volume_name': 'volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39', 'volume_size': 2}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5dc6cbb-33ca-49ca-a84f-fa39184e544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5dc6cbb-33ca-49ca-a84f-fa39184e544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b814c9-8b3e-4c1f-aeab-6639cc875923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:56 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Volume acc5011b-b7e7-4501-885a-8fb0e14c6a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39', 'volume_size': 2}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-893604467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc5011b-b7e7-4501-885a-8fb0e14c6a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80251add718b40a1a37b4a4332ec009e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:40:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:40:57Z,use_quota=True,user_id='0d1ed02d4fa34de2af77d9e2bf8620fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Creating volume acc5011b-b7e7-4501-885a-8fb0e14c6a39 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:40:56 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39 2147483648 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:56 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39 2147483648
Apr 16 02:40:56 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:56 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22" returned: 0 in 0.945s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a249936b-eb44-4693-949c-a815e42c08ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:56 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69
Apr 16 02:40:56 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:57 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" returned: 0 in 0.864s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21611211-95c8-4975-b81b-f3b0528e7884(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69186e2-a558-4df3-81e5-b21e4db85591]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:57 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39 2147483648" returned: 0 in 0.738s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:57 devstack sudo[88579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884
Apr 16 02:40:57 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:57 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39
Apr 16 02:40:57 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:57 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69" returned: 0 in 0.736s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:57 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69
Apr 16 02:40:57 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:57 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884" returned: 0 in 0.650s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:57 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39" returned: 0 in 0.516s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:40:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b814c9-8b3e-4c1f-aeab-6639cc875923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39', 'volume_size': 2}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:58 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886
Apr 16 02:40:58 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7ed37a-e3b0-47af-b41c-bb9ab35e6f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:40:58 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Volume volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39 (acc5011b-b7e7-4501-885a-8fb0e14c6a39): created successfully
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7ed37a-e3b0-47af-b41c-bb9ab35e6f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Flow 'volume_create_manager' (a6aee18a-d178-4dc6-b5a6-47cf5d192afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:40:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-97c23bec-6792-4d05-8cc5-9f0f7722ce2b tempest-VolumesCloneNegativeTest-1403731582 None] Created volume successfully.
Apr 16 02:40:58 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.e2ef6514-6384-4357-965b-5faf6376cc69" returned: 0 in 0.497s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-e2ef6514-6384-4357-965b-5faf6376cc69" released by "_delete_snapshot" :: held 3.034s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" released by "delete_snapshot" :: held 3.047s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Created reservations ['f415e498-5f99-4941-a0e0-fcc3e7e288cc', '2fb15f7a-bcdc-427d-8878-3c6fac77d1b8', '293aae82-65de-4de3-aa4d-f991f01dd371', 'e4fb622b-4aeb-4963-bcd0-27988aaa2567'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Delete snapshot completed successfully.
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ef3f90cf-9d1e-46b1-bad3-c8e6fd8c95a0 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-e2ef6514-6384-4357-965b-5faf6376cc69-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-49e2d444-0218-41c1-a867-886612386f22-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-49e2d444-0218-41c1-a867-886612386f22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-quobyte-49e2d444-0218-41c1-a867-886612386f22" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-49e2d444-0218-41c1-a867-886612386f22" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Deleting offline snapshot 49e2d444-0218-41c1-a867-886612386f22 of volume a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] snapshot_file for this snap is: volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9cf5ab-1f79-4b2c-b6d4-1da36af6cb62]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:58 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22
Apr 16 02:40:58 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:58 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" returned: 0 in 0.677s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:58 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886
Apr 16 02:40:58 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Acquiring lock "cinder-acc5011b-b7e7-4501-885a-8fb0e14c6a39-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Lock "cinder-acc5011b-b7e7-4501-885a-8fb0e14c6a39-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Acquiring lock "cinder-quobyte-acc5011b-b7e7-4501-885a-8fb0e14c6a39" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Lock "cinder-quobyte-acc5011b-b7e7-4501-885a-8fb0e14c6a39" acquired by "delete_volume" :: waited 0.018s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff00294-76ff-4c53-b422-f7e8aa7b084c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:59 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22" returned: 0 in 0.758s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a249936b-eb44-4693-949c-a815e42c08ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a6867-dc73-4146-a0ad-ed60539ed7b6]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:59 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39
Apr 16 02:40:59 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:59 devstack sudo[88607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce
Apr 16 02:40:59 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:59 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884.6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" returned: 0 in 0.640s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-quobyte-6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886" released by "_delete_snapshot" :: held 2.947s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-quobyte-21611211-95c8-4975-b81b-f3b0528e7884" released by "delete_snapshot" :: held 2.979s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Created reservations ['9beff6e8-c3ef-4454-b2dc-616c03e4d627', '9a3615f7-5db4-44c7-9b65-52f26065ae07', '969449db-63ac-478a-9f29-b4f3278ea047', '275655d8-446d-4619-9225-62f1b40a5ffb'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:40:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Delete snapshot completed successfully.
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2fea12a7-d743-4716-a080-21be4d98c3a6 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-6ffd6cf1-4eb2-4f13-bc53-c3c3a2df1886-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "cinder-21611211-95c8-4975-b81b-f3b0528e7884-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-21611211-95c8-4975-b81b-f3b0528e7884-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "cinder-quobyte-21611211-95c8-4975-b81b-f3b0528e7884" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:40:59 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-quobyte-21611211-95c8-4975-b81b-f3b0528e7884" acquired by "delete_volume" :: waited 0.060s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39" returned: 0 in 0.770s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2f2d90-5079-4f65-a55e-1503b049ad8c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:59 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce" returned: 0 in 0.782s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:59 devstack sudo[88639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39
Apr 16 02:40:59 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:40:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:40:59 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22
Apr 16 02:40:59 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:00 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884
Apr 16 02:41:00 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:00 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:00 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:00 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884" returned: 0 in 1.053s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:00 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.947s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:00 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:00 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884
Apr 16 02:41:00 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-acc5011b-b7e7-4501-885a-8fb0e14c6a39" returned: 0 in 1.110s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:00 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22" returned: 0 in 1.047s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Lock "cinder-quobyte-acc5011b-b7e7-4501-885a-8fb0e14c6a39" released by "delete_volume" :: held 1.928s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:00 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22
Apr 16 02:41:00 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:00 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=106,cinder:INSERT=28,cinder:UPDATE=101,cinder:DELETE=11 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Created reservations ['d62f9bdf-8b1e-43ae-9b6e-49128f4e4b69', '9c8fb500-09cc-4e3f-9ff0-ab90338e63d3', '33ab913c-207a-4101-9298-991b2a4137fa', '63bb2924-dd4d-4b53-864e-7152228d3c18'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:01 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:01 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:01 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-21611211-95c8-4975-b81b-f3b0528e7884" returned: 0 in 0.772s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-quobyte-21611211-95c8-4975-b81b-f3b0528e7884" released by "delete_volume" :: held 1.899s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:UPDATE=107,cinder:DELETE=7,cinder:SELECT=97,cinder:INSERT=35 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Created reservations ['d30cd5d9-849d-45ea-8f24-9502fb1abaa2', 'ecd171e4-f664-4678-a523-5350ff5406a2', 'b596f990-d276-4971-acd3-88915d3827cb', '96295d00-cd7a-488e-a322-e0ce31b7a0a4'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:01 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:01 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:02 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce.49e2d444-0218-41c1-a867-886612386f22" returned: 0 in 1.398s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-49e2d444-0218-41c1-a867-886612386f22" released by "_delete_snapshot" :: held 4.056s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" released by "delete_snapshot" :: held 4.071s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Created reservations ['d166f5cc-f9c9-4392-993a-748c1c2cfecb', '208b9913-e88a-40da-8fcc-7fefcc20d790', '74a77421-9e6d-439a-a9a2-4f9ad32272e4', '3d1aa98e-7c58-4c3c-b28a-2258e9849876'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:02 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.419s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Deleted volume successfully.
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d64f243f-0657-4d8d-be2b-ba40ad938bbf tempest-VolumesCloneNegativeTest-1403731582 None] Lock "cinder-acc5011b-b7e7-4501-885a-8fb0e14c6a39-delete_volume" released by "delete_volume" :: held 3.681s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Delete snapshot completed successfully.
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c1fbcf27-ee81-40b4-bdda-1a106f15fa96 tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-49e2d444-0218-41c1-a867-886612386f22-delete_snapshot" released by "delete_snapshot" :: held 4.379s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:02 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.007s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Deleted volume successfully.
Apr 16 02:41:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d8e820bb-2dc6-4f25-8c00-749a7033c472 tempest-SnapshotMetadataTestJSON-2036542063 None] Lock "cinder-21611211-95c8-4975-b81b-f3b0528e7884-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-a249936b-eb44-4693-949c-a815e42c08ce-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-a249936b-eb44-4693-949c-a815e42c08ce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:03 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2d1f0-6b15-4ad9-9cd5-3506f7439395]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:04 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce
Apr 16 02:41:04 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:04 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce" returned: 0 in 0.713s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:04 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce
Apr 16 02:41:04 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Flow 'volume_create_manager' (776ffb12-d720-4f9e-9fe9-b0047139de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ac3abb-b1b3-4caf-8311-209d458a3fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ac3abb-b1b3-4caf-8311-209d458a3fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1868555623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadd4f01-0331-4ad1-a243-ebde30fb6fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb54c882e96849239f9ec55dc85ad551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:05Z,use_quota=True,user_id='710e5e28d2544465ab879f9c81de1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f581abf0-888b-4249-bc37-26edf849a099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f581abf0-888b-4249-bc37-26edf849a099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be36917d-5e0e-48ef-ab4c-617089fba2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be36917d-5e0e-48ef-ab4c-617089fba2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadd4f01-0331-4ad1-a243-ebde30fb6fc8', 'volume_name': 'volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43a7300-dc8b-4dc4-8102-05249d95e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43a7300-dc8b-4dc4-8102-05249d95e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13145067-533a-489e-863b-0807af9f9136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Volume fadd4f01-0331-4ad1-a243-ebde30fb6fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8', 'volume_size': 1}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1868555623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadd4f01-0331-4ad1-a243-ebde30fb6fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb54c882e96849239f9ec55dc85ad551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:05Z,use_quota=True,user_id='710e5e28d2544465ab879f9c81de1734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Creating volume fadd4f01-0331-4ad1-a243-ebde30fb6fc8 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:05 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:05 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8 1073741824
Apr 16 02:41:05 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:05 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a249936b-eb44-4693-949c-a815e42c08ce" returned: 0 in 0.681s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-quobyte-a249936b-eb44-4693-949c-a815e42c08ce" released by "delete_volume" :: held 1.471s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Flow 'volume_create_manager' (eacda954-cfd2-4e20-bebd-b970beb40b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8661dc87-f25b-4d45-b2b8-ba416b4a338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8661dc87-f25b-4d45-b2b8-ba416b4a338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-731346529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876c9ae8-e548-4329-a86f-903cb6c9ee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f5109481b4e0f95818dff3ab77825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:05Z,use_quota=True,user_id='d9282f68fb7b414cbad5282c133ef8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5675fdc0-8901-40c8-b976-14bfdf4da8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5675fdc0-8901-40c8-b976-14bfdf4da8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b381628-ad76-4b45-a2c5-825906ebe231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b381628-ad76-4b45-a2c5-825906ebe231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876c9ae8-e548-4329-a86f-903cb6c9ee7a', 'volume_name': 'volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a', 'volume_size': 2}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7396fd3c-29a6-4330-9203-897b67041c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7396fd3c-29a6-4330-9203-897b67041c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e22687-18fa-4024-9f6a-1946e4b9c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:05 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Volume 876c9ae8-e548-4329-a86f-903cb6c9ee7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a', 'volume_size': 2}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Created reservations ['d05acb27-ee8f-4d31-a3f9-a0c2d4a2580f', '1390d784-050a-479f-8944-94169b2d5e3a', '4aa8b395-dce9-4bf4-a5e7-1ef5dd8207f9', '3971f59c-b126-4b74-8f78-66f904cdd363'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:05 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:05 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:05 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8 1073741824" returned: 0 in 0.702s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:05 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8
Apr 16 02:41:05 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:06 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.592s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Deleted volume successfully.
Apr 16 02:41:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-177c115b-7725-426f-bca7-def82ce434a2 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Terminate volume connection completed successfully.
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-177c115b-7725-426f-bca7-def82ce434a2 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Deleting attachment d7b379c9-1060-493e-9ef3-e0cc56782662. {{(pid=83205) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b13ebe53-1eba-48e4-a2dc-b79f92d99e3a tempest-VolumesSnapshotListTestJSON-3423642 None] Lock "cinder-a249936b-eb44-4693-949c-a815e42c08ce-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:06 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8" returned: 0 in 0.547s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-731346529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876c9ae8-e548-4329-a86f-903cb6c9ee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c77f5109481b4e0f95818dff3ab77825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:05Z,use_quota=True,user_id='d9282f68fb7b414cbad5282c133ef8d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Creating volume 876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:06 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a 2147483648 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13145067-533a-489e-863b-0807af9f9136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:06 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a 2147483648
Apr 16 02:41:06 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964646d3-267c-41ef-aa2c-e7e03d3847a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:06 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Volume volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8 (fadd4f01-0331-4ad1-a243-ebde30fb6fc8): created successfully
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964646d3-267c-41ef-aa2c-e7e03d3847a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Flow 'volume_create_manager' (776ffb12-d720-4f9e-9fe9-b0047139de27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0f70b16f-c562-42e4-942e-40dc2e5f36c8 tempest-VolumesMetadataTest-612916573 None] Created volume successfully.
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "cinder-65587b1f-283b-4f22-8479-48d63050e772-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-65587b1f-283b-4f22-8479-48d63050e772-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "cinder-quobyte-65587b1f-283b-4f22-8479-48d63050e772" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-quobyte-65587b1f-283b-4f22-8479-48d63050e772" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[884476bd-b0c1-4ce8-94f1-15a93665d5bf]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:06 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:41:06 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:07 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a 2147483648" returned: 0 in 0.609s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:07 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a
Apr 16 02:41:07 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:07 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 0 in 0.729s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:07 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:41:07 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:07 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a" returned: 0 in 0.663s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e22687-18fa-4024-9f6a-1946e4b9c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a', 'volume_size': 2}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774b8b45-33a5-4a10-844a-02f62b8f2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:07 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Volume volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a (876c9ae8-e548-4329-a86f-903cb6c9ee7a): created successfully
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774b8b45-33a5-4a10-844a-02f62b8f2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Flow 'volume_create_manager' (eacda954-cfd2-4e20-bebd-b970beb40b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:07 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-df186b16-f06f-4f6b-963a-159f94bc805a tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Created volume successfully.
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Acquiring lock "cinder-fadd4f01-0331-4ad1-a243-ebde30fb6fc8-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Lock "cinder-fadd4f01-0331-4ad1-a243-ebde30fb6fc8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Acquiring lock "cinder-quobyte-fadd4f01-0331-4ad1-a243-ebde30fb6fc8" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Lock "cinder-quobyte-fadd4f01-0331-4ad1-a243-ebde30fb6fc8" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[37138b02-d73e-44b8-80b0-1aead6edec19]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:08 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8
Apr 16 02:41:08 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:08 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 1 in 0.686s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:08 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772
Apr 16 02:41:08 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:08 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8" returned: 0 in 0.633s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:08 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8
Apr 16 02:41:08 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (b7373423-5be5-4c8f-8651-00774493c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3117d3-70da-46b8-bb7d-7b6e88255d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3117d3-70da-46b8-bb7d-7b6e88255d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551928528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4c94f4-26ab-44db-aab8-41e6727beec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:09Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13ba9cf-de36-4bd0-8876-5a776c2eaba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13ba9cf-de36-4bd0-8876-5a776c2eaba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682deeb3-6b90-4322-b57f-ab6669e28ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682deeb3-6b90-4322-b57f-ab6669e28ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4c94f4-26ab-44db-aab8-41e6727beec7', 'volume_name': 'volume-4f4c94f4-26ab-44db-aab8-41e6727beec7', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29758a4e-ac07-4592-b8b3-86a6f9739996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29758a4e-ac07-4592-b8b3-86a6f9739996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:08 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8947d16-1357-48dd-a204-3bb1227c6f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:08 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume 4f4c94f4-26ab-44db-aab8-41e6727beec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4c94f4-26ab-44db-aab8-41e6727beec7', 'volume_size': 1}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551928528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4c94f4-26ab-44db-aab8-41e6727beec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:09Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Creating volume 4f4c94f4-26ab-44db-aab8-41e6727beec7 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:08 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-65587b1f-283b-4f22-8479-48d63050e772" returned: 0 in 0.574s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:08 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7 1073741824
Apr 16 02:41:08 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-quobyte-65587b1f-283b-4f22-8479-48d63050e772" released by "delete_volume" :: held 2.055s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.quota [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Created reservations ['3d175415-c800-45c2-a318-651711a1b148', 'e18b3cc6-89d2-4bba-a687-90fea2bf4608', 'a841b402-b5f7-4d24-b1e0-355547538910', '02606951-f553-48e6-8246-36af15715193'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:08 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:08 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:09 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fadd4f01-0331-4ad1-a243-ebde30fb6fc8" returned: 0 in 0.516s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Lock "cinder-quobyte-fadd4f01-0331-4ad1-a243-ebde30fb6fc8" released by "delete_volume" :: held 1.176s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Created reservations ['9cc5ea10-d34b-4409-a1af-eb7422b4b39f', '53d4ac68-9753-41a0-9fb2-036ebf6d0fb8', 'f65c8694-8ea9-4040-a500-7252d956aabc', '14b5f0b1-348f-497a-933f-c5530630c58f'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:09 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:09 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:09 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7 1073741824" returned: 0 in 0.538s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:09 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7
Apr 16 02:41:09 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:09 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.manager [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Deleted volume successfully.
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-a5d8417f-d921-442d-97b6-b853ea205d81 req-c4b6e081-85c9-4c43-b03d-e725baf4985a tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-65587b1f-283b-4f22-8479-48d63050e772-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:09 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.463s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Deleted volume successfully.
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eecdba01-f397-4adc-8b11-54705023a880 tempest-VolumesMetadataTest-612916573 None] Lock "cinder-fadd4f01-0331-4ad1-a243-ebde30fb6fc8-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:09 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7" returned: 0 in 0.479s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.020s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8947d16-1357-48dd-a204-3bb1227c6f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4c94f4-26ab-44db-aab8-41e6727beec7', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82e68c9-e051-460c-8ab3-010fc3eb0453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Creating offline snapshot c0106799-4fca-4320-8577-3d0dfe56078e of volume 876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:41:09 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume volume-4f4c94f4-26ab-44db-aab8-41e6727beec7 (4f4c94f4-26ab-44db-aab8-41e6727beec7): created successfully
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82e68c9-e051-460c-8ab3-010fc3eb0453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (b7373423-5be5-4c8f-8651-00774493c804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba728a4d-c220-4638-a6b7-6f7afc6cafb7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2369d768-6363-43ea-b2ed-94ddc4cb4b18 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created volume successfully.
Apr 16 02:41:09 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a
Apr 16 02:41:09 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:10 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a" returned: 0 in 0.628s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e 2G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:10 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e 2G
Apr 16 02:41:10 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (dd819b2d-fbdb-4079-9e01-69321fa123b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb877675-b168-4955-8bff-07685fa79e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb877675-b168-4955-8bff-07685fa79e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246246432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089ad9bc-c58a-43f3-9826-3a522f68451c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:11Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cc4e72-aedf-4d57-8c37-1bc1715aea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cc4e72-aedf-4d57-8c37-1bc1715aea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf6e68e-915a-444b-990e-6e48a5db126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf6e68e-915a-444b-990e-6e48a5db126d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089ad9bc-c58a-43f3-9826-3a522f68451c', 'volume_name': 'volume-089ad9bc-c58a-43f3-9826-3a522f68451c', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccafa33-b42f-4897-b0e1-774b1675c38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccafa33-b42f-4897-b0e1-774b1675c38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5e14f6-21ce-4b8a-a830-96ade013a23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume 089ad9bc-c58a-43f3-9826-3a522f68451c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089ad9bc-c58a-43f3-9826-3a522f68451c', 'volume_size': 1}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:11 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e 2G" returned: 0 in 0.668s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:11 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e
Apr 16 02:41:11 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (f261964a-0f8c-4b57-adf6-3f647a8d60c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea07446c-e002-400a-96ac-c67ce350ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea07446c-e002-400a-96ac-c67ce350ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473238950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591bb122-2eee-47e5-ac62-32efc1c5f3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:11Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b25297-dcd5-4a85-85f0-ed2c9ae7b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b25297-dcd5-4a85-85f0-ed2c9ae7b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8869cc48-489e-4a3c-b443-df0b0e4536ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8869cc48-489e-4a3c-b443-df0b0e4536ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591bb122-2eee-47e5-ac62-32efc1c5f3b3', 'volume_name': 'volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36587609-f2b1-4bc6-b6bb-12a28fb1ebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36587609-f2b1-4bc6-b6bb-12a28fb1ebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8468923a-6ad7-4ddc-87e6-cfe77926f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume 591bb122-2eee-47e5-ac62-32efc1c5f3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3', 'volume_size': 1}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (9b653fde-063c-4bd2-bea2-a198b1bc60b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de793bf7-711a-4ffa-8284-523e9118547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de793bf7-711a-4ffa-8284-523e9118547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320127651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7233f994-4eea-4750-90b6-2ee2598ada49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:12Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfe062b-2c4e-4316-ba73-aa7e42e33a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfe062b-2c4e-4316-ba73-aa7e42e33a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a762cee-1e8b-4811-b7b4-0b877df8a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a762cee-1e8b-4811-b7b4-0b877df8a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7233f994-4eea-4750-90b6-2ee2598ada49', 'volume_name': 'volume-7233f994-4eea-4750-90b6-2ee2598ada49', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a525ffd-03d3-4b6d-99c7-9f7ad75d75ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a525ffd-03d3-4b6d-99c7-9f7ad75d75ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38771382-6057-4114-8016-087c22688c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume 7233f994-4eea-4750-90b6-2ee2598ada49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7233f994-4eea-4750-90b6-2ee2598ada49', 'volume_size': 1}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:11 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (e72c12e2-67c7-457f-bb29-f3cd853955ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4be53c-f4d4-45e2-8ef4-1b8e3ade0939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4be53c-f4d4-45e2-8ef4-1b8e3ade0939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294470067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e139d152-fa57-4510-b935-abbac6ec83ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:12Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e8990c-7c1e-4ca5-91ed-85786177e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e8990c-7c1e-4ca5-91ed-85786177e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ff854b-8fce-480c-908a-11c99ddd7e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ff854b-8fce-480c-908a-11c99ddd7e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e139d152-fa57-4510-b935-abbac6ec83ff', 'volume_name': 'volume-e139d152-fa57-4510-b935-abbac6ec83ff', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf0b592-be97-40ba-b2f3-3d04ff589f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf0b592-be97-40ba-b2f3-3d04ff589f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24db17f9-4aba-441d-afe8-7a66c422fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume e139d152-fa57-4510-b935-abbac6ec83ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e139d152-fa57-4510-b935-abbac6ec83ff', 'volume_size': 1}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e" returned: 0 in 0.885s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:12 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e is being set with open permissions: ugo+rw
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:12 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e
Apr 16 02:41:12 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (500c29e3-f152-45a1-b71b-9d60cbfa653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d752f36-bbaa-497a-9b1e-0c6840c38250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d752f36-bbaa-497a-9b1e-0c6840c38250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480243507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba25d9f0-1b4b-4bda-a852-35b552de69ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:12Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af68f178-d0c0-43ea-98ba-98c5a3d12e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af68f178-d0c0-43ea-98ba-98c5a3d12e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05239a37-c215-46da-b431-8d087e15c52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05239a37-c215-46da-b431-8d087e15c52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba25d9f0-1b4b-4bda-a852-35b552de69ff', 'volume_name': 'volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dd8a56-e7ba-488e-ac98-35823d246a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70dd8a56-e7ba-488e-ac98-35823d246a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4620f99-7695-4044-86cf-9671e8e390a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:12 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume ba25d9f0-1b4b-4bda-a852-35b552de69ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff', 'volume_size': 1}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:12 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e" returned: 0 in 0.559s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:12 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.info
Apr 16 02:41:12 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:13 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.info" returned: 0 in 0.495s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:13 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.info is being set with open permissions: ugo+rw
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:13 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.info
Apr 16 02:41:13 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:13 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.info" returned: 0 in 0.448s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.776s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246246432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089ad9bc-c58a-43f3-9826-3a522f68451c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:11Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Creating volume 089ad9bc-c58a-43f3-9826-3a522f68451c {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:13 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:13 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c 1073741824
Apr 16 02:41:13 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:13 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-628b9cb1-a49c-4853-a652-8eb6cf2c68ef tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Create snapshot completed successfully
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Flow 'volume_create_manager' (56b8ec49-ae82-4063-afb6-9f3133f595b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c178858-ff2a-4141-ad57-e1d6c9604a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c178858-ff2a-4141-ad57-e1d6c9604a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-177841391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f622720-510b-4554-bb45-8ae8ce011f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c85bf2cf1a5472aaf452b655db5a5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:14Z,use_quota=True,user_id='a568b2606db34ce2a58f54aeb98de281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d16f1c2-142e-426f-9a0f-ee6a32e609fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d16f1c2-142e-426f-9a0f-ee6a32e609fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c027133a-634e-4850-8d80-bcc4d7ba4fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c027133a-634e-4850-8d80-bcc4d7ba4fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f622720-510b-4554-bb45-8ae8ce011f00', 'volume_name': 'volume-6f622720-510b-4554-bb45-8ae8ce011f00', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266f67c9-545c-4ab6-9c1f-a9113d14c28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266f67c9-545c-4ab6-9c1f-a9113d14c28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0160a719-ecd5-48c4-8477-9dbea72d1213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:13 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Volume 6f622720-510b-4554-bb45-8ae8ce011f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f622720-510b-4554-bb45-8ae8ce011f00', 'volume_size': 1}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "cinder-c0106799-4fca-4320-8577-3d0dfe56078e-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-c0106799-4fca-4320-8577-3d0dfe56078e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "cinder-quobyte-876c9ae8-e548-4329-a86f-903cb6c9ee7a" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-quobyte-876c9ae8-e548-4329-a86f-903cb6c9ee7a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "cinder-quobyte-c0106799-4fca-4320-8577-3d0dfe56078e" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-quobyte-c0106799-4fca-4320-8577-3d0dfe56078e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Deleting offline snapshot c0106799-4fca-4320-8577-3d0dfe56078e of volume 876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:41:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] snapshot_file for this snap is: volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec44da-f148-48d0-a839-e72799d52816]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:14 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e
Apr 16 02:41:14 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:14 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c 1073741824" returned: 0 in 0.560s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:14 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c
Apr 16 02:41:14 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:14 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e" returned: 0 in 0.565s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[916e20f2-99c8-408b-8287-be845cdee53f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:14 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c" returned: 0 in 0.443s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473238950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591bb122-2eee-47e5-ac62-32efc1c5f3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:11Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Creating volume 591bb122-2eee-47e5-ac62-32efc1c5f3b3 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:14 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:14 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a
Apr 16 02:41:14 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5e14f6-21ce-4b8a-a830-96ade013a23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089ad9bc-c58a-43f3-9826-3a522f68451c', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:14 devstack sudo[88920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3 1073741824
Apr 16 02:41:14 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46ef582-75cd-41f3-a0e8-b9ac27a6fbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume volume-089ad9bc-c58a-43f3-9826-3a522f68451c (089ad9bc-c58a-43f3-9826-3a522f68451c): created successfully
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46ef582-75cd-41f3-a0e8-b9ac27a6fbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (dd819b2d-fbdb-4079-9e01-69321fa123b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:14 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3e4ddf98-f786-4c0f-b446-b53fb388c681 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created volume successfully.
Apr 16 02:41:15 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a" returned: 0 in 0.537s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:15 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e
Apr 16 02:41:15 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:15 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3 1073741824" returned: 0 in 0.542s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:15 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3
Apr 16 02:41:15 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:15 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e" returned: 0 in 0.500s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:15 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e
Apr 16 02:41:15 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:15 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3" returned: 0 in 0.505s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.939s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320127651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7233f994-4eea-4750-90b6-2ee2598ada49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:12Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Creating volume 7233f994-4eea-4750-90b6-2ee2598ada49 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:15 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8468923a-6ad7-4ddc-87e6-cfe77926f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:15 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49 1073741824
Apr 16 02:41:15 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56a6223-0558-481e-824d-ea84d7a5e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:15 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3 (591bb122-2eee-47e5-ac62-32efc1c5f3b3): created successfully
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56a6223-0558-481e-824d-ea84d7a5e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (f261964a-0f8c-4b57-adf6-3f647a8d60c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:15 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d25d8662-2f8b-4cf7-913d-9d9bf24d5975 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created volume successfully.
Apr 16 02:41:16 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a.c0106799-4fca-4320-8577-3d0dfe56078e" returned: 0 in 0.435s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-quobyte-c0106799-4fca-4320-8577-3d0dfe56078e" released by "_delete_snapshot" :: held 2.101s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-quobyte-876c9ae8-e548-4329-a86f-903cb6c9ee7a" released by "delete_snapshot" :: held 2.123s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Created reservations ['388df56e-938d-409c-ade6-c90d592db5a5', 'bb72356c-980b-45ba-a5bc-1750e54ad10c', '91fbc17f-40ae-44bf-9832-e99c4ca9fcae', '87571b43-63fe-4b13-a18f-8968c12a5397'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Delete snapshot completed successfully.
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e688053-62e0-408d-9e54-302104147af5 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-c0106799-4fca-4320-8577-3d0dfe56078e-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:16 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49 1073741824" returned: 0 in 0.516s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:16 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49
Apr 16 02:41:16 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:16 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49" returned: 0 in 0.479s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.725s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-294470067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e139d152-fa57-4510-b935-abbac6ec83ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:12Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Creating volume e139d152-fa57-4510-b935-abbac6ec83ff {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:16 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38771382-6057-4114-8016-087c22688c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7233f994-4eea-4750-90b6-2ee2598ada49', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:16 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff 1073741824
Apr 16 02:41:16 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24ea432-6eb0-4c05-ada3-fdf08a5e63e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:16 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume volume-7233f994-4eea-4750-90b6-2ee2598ada49 (7233f994-4eea-4750-90b6-2ee2598ada49): created successfully
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24ea432-6eb0-4c05-ada3-fdf08a5e63e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (9b653fde-063c-4bd2-bea2-a198b1bc60b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c6683ec9-2e5f-4714-9af9-b0a37853ecdd tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created volume successfully.
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "cinder-876c9ae8-e548-4329-a86f-903cb6c9ee7a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-876c9ae8-e548-4329-a86f-903cb6c9ee7a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "cinder-quobyte-876c9ae8-e548-4329-a86f-903cb6c9ee7a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-quobyte-876c9ae8-e548-4329-a86f-903cb6c9ee7a" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[67500a69-61ed-459e-8312-7dcb1da55d00]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:17 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a
Apr 16 02:41:17 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:17 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff 1073741824" returned: 0 in 0.545s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:17 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff
Apr 16 02:41:17 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:17 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a" returned: 0 in 0.660s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:17 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a
Apr 16 02:41:17 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:17 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff" returned: 0 in 0.567s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.634s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1480243507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba25d9f0-1b4b-4bda-a852-35b552de69ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a27659e79564a9bb7e7a9958def47ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:12Z,use_quota=True,user_id='3d26cab4d19b486ab96acd1acab6dde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Creating volume ba25d9f0-1b4b-4bda-a852-35b552de69ff {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:17 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:17 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff 1073741824
Apr 16 02:41:17 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24db17f9-4aba-441d-afe8-7a66c422fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e139d152-fa57-4510-b935-abbac6ec83ff', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b065fa-44c2-4768-96dc-b9c44413e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:17 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume volume-e139d152-fa57-4510-b935-abbac6ec83ff (e139d152-fa57-4510-b935-abbac6ec83ff): created successfully
Apr 16 02:41:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b065fa-44c2-4768-96dc-b9c44413e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (e72c12e2-67c7-457f-bb29-f3cd853955ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ba8826f4-2708-4da8-bf95-46cd76c21b9e tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created volume successfully.
Apr 16 02:41:18 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-876c9ae8-e548-4329-a86f-903cb6c9ee7a" returned: 0 in 0.510s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-quobyte-876c9ae8-e548-4329-a86f-903cb6c9ee7a" released by "delete_volume" :: held 1.205s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Created reservations ['b1bc7e97-960d-475a-890b-88696095ac52', '1246f16a-9ded-4bb8-8a77-52d358ad3b86', '2de05ea0-f0f3-466a-90f7-0f3c26a0b573', 'b3122ab7-e368-4534-80e4-013c509fcf5a'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:18 devstack sudo[88997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:18 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:18 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff 1073741824" returned: 0 in 0.646s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:18 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff
Apr 16 02:41:18 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:18 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.464s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Deleted volume successfully.
Apr 16 02:41:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f34ce152-17e1-4447-b07d-c6f91ac5ac98 tempest-VolumesSnapshotNegativeTestJSON-1584344978 None] Lock "cinder-876c9ae8-e548-4329-a86f-903cb6c9ee7a-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:19 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.354s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-177841391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f622720-510b-4554-bb45-8ae8ce011f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c85bf2cf1a5472aaf452b655db5a5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:14Z,use_quota=True,user_id='a568b2606db34ce2a58f54aeb98de281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Creating volume 6f622720-510b-4554-bb45-8ae8ce011f00 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:19 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4620f99-7695-4044-86cf-9671e8e390a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb37d6b-6297-4d65-8fb9-0fa2eda2b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:19 devstack sudo[89005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00 1073741824
Apr 16 02:41:19 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:19 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Volume volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff (ba25d9f0-1b4b-4bda-a852-35b552de69ff): created successfully
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb37d6b-6297-4d65-8fb9-0fa2eda2b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Flow 'volume_create_manager' (500c29e3-f152-45a1-b71b-9d60cbfa653c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:19 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2427b1ba-91ad-4016-a9d3-cfd6d69dd2d9 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created volume successfully.
Apr 16 02:41:19 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00 1073741824" returned: 0 in 0.613s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:19 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00
Apr 16 02:41:19 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-ba25d9f0-1b4b-4bda-a852-35b552de69ff-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-ba25d9f0-1b4b-4bda-a852-35b552de69ff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-quobyte-ba25d9f0-1b4b-4bda-a852-35b552de69ff" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-ba25d9f0-1b4b-4bda-a852-35b552de69ff" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79b7b2b-9046-4d36-95a3-93f8dc4345ba]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:20 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff
Apr 16 02:41:20 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:20 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0160a719-ecd5-48c4-8477-9dbea72d1213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f622720-510b-4554-bb45-8ae8ce011f00', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb8deec-67f1-447c-aadc-b9f2e3cf82f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:20 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Volume volume-6f622720-510b-4554-bb45-8ae8ce011f00 (6f622720-510b-4554-bb45-8ae8ce011f00): created successfully
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb8deec-67f1-447c-aadc-b9f2e3cf82f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Flow 'volume_create_manager' (56b8ec49-ae82-4063-afb6-9f3133f595b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:20 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-30b5d6ce-b00a-473b-8739-3571da92b557 tempest-VolumesTransfersV355Test-54796805 None] Created volume successfully.
Apr 16 02:41:20 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-f718509d-de68-495a-a133-f2b3b5f71137 req-524e1062-59b5-4c3f-a962-d0d7477d0b83 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Terminate volume connection completed successfully.
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-f718509d-de68-495a-a133-f2b3b5f71137 req-524e1062-59b5-4c3f-a962-d0d7477d0b83 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Deleting attachment c893f73f-6e85-44d9-9582-eeb6bbf6f799. {{(pid=83205) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 16 02:41:20 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff" returned: 0 in 0.651s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:20 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff
Apr 16 02:41:20 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "cinder-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "cinder-quobyte-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-quobyte-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a750d748-77e6-4392-bd46-af132ab71f9e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:21 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b
Apr 16 02:41:21 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:21 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ba25d9f0-1b4b-4bda-a852-35b552de69ff" returned: 0 in 0.496s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-ba25d9f0-1b4b-4bda-a852-35b552de69ff" released by "delete_volume" :: held 1.190s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created reservations ['07bdba57-e53b-42f9-aa4a-c0a8c1b4c1b4', 'ffe9770c-a4e9-4037-b39b-3e5146df4c50', 'ec377e64-313f-4e8a-b8b4-494a406061c0', '0d7ff973-63de-4d71-aa8b-f95da24d7ec8'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:21 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:21 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (6b6adff7-88c9-4ce3-8c1d-0cc5c361effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5748c407-4141-4ee1-9c4e-3606d3210c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5748c407-4141-4ee1-9c4e-3606d3210c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1251342207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602c3c62-e814-4338-b084-2acc4993f3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:21Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b672de0-ef46-46f8-919b-8582122293fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b672de0-ef46-46f8-919b-8582122293fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8384d122-b111-4869-8cee-9410e6365984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8384d122-b111-4869-8cee-9410e6365984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602c3c62-e814-4338-b084-2acc4993f3d9', 'volume_name': 'volume-602c3c62-e814-4338-b084-2acc4993f3d9', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902d9957-6e5d-4a82-a292-15e9fd98bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902d9957-6e5d-4a82-a292-15e9fd98bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893cda0b-f9a9-4910-8c85-ce41a6c17538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Volume 602c3c62-e814-4338-b084-2acc4993f3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602c3c62-e814-4338-b084-2acc4993f3d9', 'volume_size': 1}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1251342207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602c3c62-e814-4338-b084-2acc4993f3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:21Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Creating volume 602c3c62-e814-4338-b084-2acc4993f3d9 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:21 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:21 devstack sudo[89027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9 1073741824
Apr 16 02:41:21 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (ffc754b5-b8cd-40c7-b2db-40cb3a17a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd18599a-296c-489f-83f3-61068ac455f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd18599a-296c-489f-83f3-61068ac455f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3871935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002b64ee-a2bd-4b22-ace4-69e66254359f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:22Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cfba89-95bd-4a9f-aee1-b7b10f6aff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cfba89-95bd-4a9f-aee1-b7b10f6aff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a05645d-e33f-4878-9a3a-a3114541a9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a05645d-e33f-4878-9a3a-a3114541a9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002b64ee-a2bd-4b22-ace4-69e66254359f', 'volume_name': 'volume-002b64ee-a2bd-4b22-ace4-69e66254359f', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb7987d-2c1d-49f0-a99d-0da831b73fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb7987d-2c1d-49f0-a99d-0da831b73fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd4e7a3-3256-4c44-8a8c-f05f7f8b5f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:21 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Volume 002b64ee-a2bd-4b22-ace4-69e66254359f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002b64ee-a2bd-4b22-ace4-69e66254359f', 'volume_size': 1}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-63e112dd-9a30-4682-9abb-7987f57310de tempest-VolumesTransfersV355Test-1625386733 None] Transfer volume completed successfully.
Apr 16 02:41:21 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b" returned: 0 in 0.769s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:21 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b
Apr 16 02:41:21 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:21 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.776s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Deleted volume successfully.
Apr 16 02:41:21 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (ee45af40-caae-4ceb-9df2-d2ab3e792f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14548b94-6585-4075-887d-d99f49c53dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14548b94-6585-4075-887d-d99f49c53dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234667866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05b17eb-37da-4652-aaae-1fe81ce0e9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:22Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6275ee4a-36bb-4c85-8d93-bcceef0e4680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6275ee4a-36bb-4c85-8d93-bcceef0e4680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d732cf7d-1e84-42ed-a6a9-570de1e5918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d732cf7d-1e84-42ed-a6a9-570de1e5918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd05b17eb-37da-4652-aaae-1fe81ce0e9e8', 'volume_name': 'volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0e2210-48e8-423d-97e7-2479f4f82891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0e2210-48e8-423d-97e7-2479f4f82891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711ae088-bb84-4d21-8506-35469da602a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Volume d05b17eb-37da-4652-aaae-1fe81ce0e9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8', 'volume_size': 1}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6560223d-188b-4643-b1c5-81c7b6d1f520 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-ba25d9f0-1b4b-4bda-a852-35b552de69ff-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (d864d4c4-40c2-47dc-8288-4880a9cc421a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ca3db3-462a-41b3-8214-974b05ea4206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ca3db3-462a-41b3-8214-974b05ea4206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639277913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa49fdc-286c-4347-8c7c-324d9089b6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:22Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5b2680-bef2-454b-b353-65af5d9f6108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5b2680-bef2-454b-b353-65af5d9f6108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd3ff8f-5237-420c-9c2f-615425d92ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd3ff8f-5237-420c-9c2f-615425d92ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa49fdc-286c-4347-8c7c-324d9089b6e1', 'volume_name': 'volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f633d0-85da-419b-8115-4414d8934ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f633d0-85da-419b-8115-4414d8934ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e266a9aa-53e9-40cf-bd70-1210a521adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Volume 4aa49fdc-286c-4347-8c7c-324d9089b6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1', 'volume_size': 1}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9 1073741824" returned: 0 in 0.772s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:22 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b" returned: 0 in 0.608s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-quobyte-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b" released by "delete_volume" :: held 1.400s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:22 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9
Apr 16 02:41:22 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.quota [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Created reservations ['19cfde62-c63c-49c6-baf5-a85889e1dfd3', 'b851e3e4-e63b-435b-8b9a-ca985d9a75bd', '93b39f78-04e0-44ea-9caa-f0acd938aaf5', 'efa12195-aae3-4b1d-b553-f2c516099bb3'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-e139d152-fa57-4510-b935-abbac6ec83ff-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-e139d152-fa57-4510-b935-abbac6ec83ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-quobyte-e139d152-fa57-4510-b935-abbac6ec83ff" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:22 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:22 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-e139d152-fa57-4510-b935-abbac6ec83ff" acquired by "delete_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (8e50b14f-6695-4122-ae82-8283224a9482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe46f013-ad9f-431d-a66a-eba03eb62800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f51bba-5c9f-4a4c-9261-907128e385d3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe46f013-ad9f-431d-a66a-eba03eb62800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1274488400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13ab070-1b7a-4180-95e7-46ee05f1be52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:23Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d573b2a4-3474-4247-bea3-e5ca1d1396cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d573b2a4-3474-4247-bea3-e5ca1d1396cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55be458b-8b37-4f18-94ca-40c4050226ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55be458b-8b37-4f18-94ca-40c4050226ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13ab070-1b7a-4180-95e7-46ee05f1be52', 'volume_name': 'volume-f13ab070-1b7a-4180-95e7-46ee05f1be52', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d370bb9-d815-4493-b638-5848ba670469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d370bb9-d815-4493-b638-5848ba670469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec49926-db00-4419-af18-e299ea616ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:22 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Volume f13ab070-1b7a-4180-95e7-46ee05f1be52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13ab070-1b7a-4180-95e7-46ee05f1be52', 'volume_size': 1}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Acquiring lock "cinder-6f622720-510b-4554-bb45-8ae8ce011f00-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-6f622720-510b-4554-bb45-8ae8ce011f00-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:22 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff
Apr 16 02:41:22 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Acquiring lock "cinder-quobyte-6f622720-510b-4554-bb45-8ae8ce011f00" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-quobyte-6f622720-510b-4554-bb45-8ae8ce011f00" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[94185da9-2287-4053-9784-6deae3018e55]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:22 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00
Apr 16 02:41:22 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:22 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9" returned: 0 in 0.631s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-3871935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=002b64ee-a2bd-4b22-ace4-69e66254359f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:22Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Creating volume 002b64ee-a2bd-4b22-ace4-69e66254359f {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:22 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893cda0b-f9a9-4910-8c85-ce41a6c17538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602c3c62-e814-4338-b084-2acc4993f3d9', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36685843-0bbb-4db4-bb52-5f227041632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:23 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f 1073741824
Apr 16 02:41:23 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:23 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Volume volume-602c3c62-e814-4338-b084-2acc4993f3d9 (602c3c62-e814-4338-b084-2acc4993f3d9): created successfully
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36685843-0bbb-4db4-bb52-5f227041632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (6b6adff7-88c9-4ce3-8c1d-0cc5c361effb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:23 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-942ab671-9cfb-4f0e-bffc-a1309914a4ff tempest-CreateVolumesFromImageTest-924722493 None] Created volume successfully.
Apr 16 02:41:23 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.589s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.manager [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:23 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Deleted volume successfully.
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-f718509d-de68-495a-a133-f2b3b5f71137 req-5493cdd5-0ee0-48d6-9b1e-c92dd00661c8 tempest-ServerBootFromVolumeStableRescueTest-1979185383 None] Lock "cinder-5d3adb69-abb8-406e-8bc3-fcc3ccb86c8b-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:23 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff" returned: 0 in 0.645s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:23 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff
Apr 16 02:41:23 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:23 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00" returned: 0 in 0.550s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:23 devstack sudo[89058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00
Apr 16 02:41:23 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:23 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f 1073741824" returned: 0 in 0.643s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:23 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f
Apr 16 02:41:23 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:23 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e139d152-fa57-4510-b935-abbac6ec83ff" returned: 0 in 0.500s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-e139d152-fa57-4510-b935-abbac6ec83ff" released by "delete_volume" :: held 1.193s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created reservations ['e2c74a0a-31e7-45cb-95e8-47a856eeaedc', '3b771353-310e-4246-b166-077c59ff50ba', 'd77fd843-efe6-4c22-a802-3f881d5c1bdc', '10eeef28-e351-465c-b131-7fe568c1c4ba'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:23 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6f622720-510b-4554-bb45-8ae8ce011f00" returned: 0 in 0.500s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-quobyte-6f622720-510b-4554-bb45-8ae8ce011f00" released by "delete_volume" :: held 1.083s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:23 devstack sudo[89067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:23 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Created reservations ['b88149c2-1421-4ce1-85a2-625d10d50aa2', 'cff363b7-5e67-489c-ae46-c20c3130920a', '44cfd2b1-8558-4eb8-b0ad-2265b651fafd', '3ba130e5-42d8-44f9-9add-2cd5f2e0d917'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:24 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:24 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:24 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f" returned: 0 in 0.452s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234667866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05b17eb-37da-4652-aaae-1fe81ce0e9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:22Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Creating volume d05b17eb-37da-4652-aaae-1fe81ce0e9e8 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:24 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd4e7a3-3256-4c44-8a8c-f05f7f8b5f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002b64ee-a2bd-4b22-ace4-69e66254359f', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2ac17b-6437-468e-a2be-c16cfdb35771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:24 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8 1073741824
Apr 16 02:41:24 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:24 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Volume volume-002b64ee-a2bd-4b22-ace4-69e66254359f (002b64ee-a2bd-4b22-ace4-69e66254359f): created successfully
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2ac17b-6437-468e-a2be-c16cfdb35771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (ffc754b5-b8cd-40c7-b2db-40cb3a17a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-422b6ecf-9603-43bf-9fa1-d8b12a9f7b06 tempest-CreateVolumesFromImageTest-924722493 None] Created volume successfully.
Apr 16 02:41:24 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.490s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Deleted volume successfully.
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0ef3decb-2c7e-416a-a94a-44d14a79de2a tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-e139d152-fa57-4510-b935-abbac6ec83ff-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:24 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.513s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Deleted volume successfully.
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6f560ef9-6b79-45d0-bc20-36edd5ee9e59 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-6f622720-510b-4554-bb45-8ae8ce011f00-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-7233f994-4eea-4750-90b6-2ee2598ada49-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-7233f994-4eea-4750-90b6-2ee2598ada49-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-quobyte-7233f994-4eea-4750-90b6-2ee2598ada49" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-7233f994-4eea-4750-90b6-2ee2598ada49" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd66f8-50f4-43c5-86a7-5e87eae1206a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:24 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8 1073741824" returned: 0 in 0.694s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:24 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49
Apr 16 02:41:24 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:24 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8
Apr 16 02:41:24 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Flow 'volume_create_manager' (54b35036-be35-4ca9-83a9-0397f61fd80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6fde2b-9756-4f6b-819c-c1cac23d30a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6fde2b-9756-4f6b-819c-c1cac23d30a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1833571934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937a08ea-a82a-4d24-a3f3-62dc5de47609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c85bf2cf1a5472aaf452b655db5a5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:25Z,use_quota=True,user_id='a568b2606db34ce2a58f54aeb98de281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9889960-89e2-4991-8e47-c8a525f71c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9889960-89e2-4991-8e47-c8a525f71c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6431aaf4-9c4e-42d4-a5d0-dcfdb3fc0fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6431aaf4-9c4e-42d4-a5d0-dcfdb3fc0fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937a08ea-a82a-4d24-a3f3-62dc5de47609', 'volume_name': 'volume-937a08ea-a82a-4d24-a3f3-62dc5de47609', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89ce7ca-535f-4d10-b76e-d4856c9c7e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89ce7ca-535f-4d10-b76e-d4856c9c7e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3135a3a4-663c-450e-8943-60605aabe9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:25 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Volume 937a08ea-a82a-4d24-a3f3-62dc5de47609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937a08ea-a82a-4d24-a3f3-62dc5de47609', 'volume_size': 1}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:25 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8" returned: 0 in 0.580s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.129s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639277913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa49fdc-286c-4347-8c7c-324d9089b6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:22Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Creating volume 4aa49fdc-286c-4347-8c7c-324d9089b6e1 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:25 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711ae088-bb84-4d21-8506-35469da602a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cb157c-a329-4629-9b54-f96521e3b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:25 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1 1073741824
Apr 16 02:41:25 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:25 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Volume volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8 (d05b17eb-37da-4652-aaae-1fe81ce0e9e8): created successfully
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cb157c-a329-4629-9b54-f96521e3b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (ee45af40-caae-4ceb-9df2-d2ab3e792f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8283868e-e971-4b1b-8cd3-dcff733463d6 tempest-CreateVolumesFromImageTest-924722493 None] Created volume successfully.
Apr 16 02:41:25 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49" returned: 0 in 0.794s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:25 devstack sudo[89119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49
Apr 16 02:41:25 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:26 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-7233f994-4eea-4750-90b6-2ee2598ada49" returned: 0 in 0.575s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-7233f994-4eea-4750-90b6-2ee2598ada49" released by "delete_volume" :: held 1.396s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:26 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1 1073741824" returned: 0 in 0.725s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created reservations ['5b1a5393-4042-4540-a414-72c8cf874428', 'd899177a-f936-4e00-941a-95428cfb9cef', 'a5314693-fa49-4ee0-a75d-35480e96f543', '534ca796-1f50-46d6-ae56-2812e653adcd'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:26 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1
Apr 16 02:41:26 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:26 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:26 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:26 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1" returned: 0 in 0.442s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.964s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1274488400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13ab070-1b7a-4180-95e7-46ee05f1be52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb2aae988d74ae9bcb49ced839ea058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:23Z,use_quota=True,user_id='47deb2c177914e21a9b3d97037146f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Creating volume f13ab070-1b7a-4180-95e7-46ee05f1be52 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:26 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e266a9aa-53e9-40cf-bd70-1210a521adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb809a0-620b-4e2c-9d74-7046853d8b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:26 devstack sudo[89133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52 1073741824
Apr 16 02:41:26 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:26 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Volume volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1 (4aa49fdc-286c-4347-8c7c-324d9089b6e1): created successfully
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb809a0-620b-4e2c-9d74-7046853d8b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (d864d4c4-40c2-47dc-8288-4880a9cc421a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:26 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f701fc64-586b-4d43-b426-005e8ef3f7a4 tempest-CreateVolumesFromImageTest-924722493 None] Created volume successfully.
Apr 16 02:41:26 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.468s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:26 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Deleted volume successfully.
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-954f8b37-178d-406f-a7dc-0338cacd74e6 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-7233f994-4eea-4750-90b6-2ee2598ada49-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-591bb122-2eee-47e5-ac62-32efc1c5f3b3-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-591bb122-2eee-47e5-ac62-32efc1c5f3b3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-quobyte-591bb122-2eee-47e5-ac62-32efc1c5f3b3" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-591bb122-2eee-47e5-ac62-32efc1c5f3b3" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ab8f73-899c-42cd-b9b2-845ebe901d92]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:27 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3
Apr 16 02:41:27 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:27 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52 1073741824" returned: 0 in 0.630s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:27 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52
Apr 16 02:41:27 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:27 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3" returned: 0 in 0.510s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:27 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3
Apr 16 02:41:27 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:27 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52" returned: 0 in 0.423s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1833571934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937a08ea-a82a-4d24-a3f3-62dc5de47609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c85bf2cf1a5472aaf452b655db5a5b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:25Z,use_quota=True,user_id='a568b2606db34ce2a58f54aeb98de281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Creating volume 937a08ea-a82a-4d24-a3f3-62dc5de47609 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:27 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec49926-db00-4419-af18-e299ea616ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13ab070-1b7a-4180-95e7-46ee05f1be52', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:27 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609 1073741824
Apr 16 02:41:27 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea4bd5c-2c06-4ee0-92a5-1f761faed23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:27 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Volume volume-f13ab070-1b7a-4180-95e7-46ee05f1be52 (f13ab070-1b7a-4180-95e7-46ee05f1be52): created successfully
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea4bd5c-2c06-4ee0-92a5-1f761faed23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Flow 'volume_create_manager' (8e50b14f-6695-4122-ae82-8283224a9482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-cd23f5b9-0cf2-412e-9005-ab325789a17d tempest-CreateVolumesFromImageTest-924722493 None] Created volume successfully.
Apr 16 02:41:28 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-591bb122-2eee-47e5-ac62-32efc1c5f3b3" returned: 0 in 0.475s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-591bb122-2eee-47e5-ac62-32efc1c5f3b3" released by "delete_volume" :: held 1.011s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created reservations ['02ace731-b913-42c6-94a3-dbc91b377015', '3b6ab9b1-2964-42c2-b188-e3f04c759e3d', '076db823-147f-49c5-9f4e-ca759ca3bb58', 'e6920c4c-420f-4896-9387-6fbb477f3f9a'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-f13ab070-1b7a-4180-95e7-46ee05f1be52-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:28 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:28 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-f13ab070-1b7a-4180-95e7-46ee05f1be52-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-quobyte-f13ab070-1b7a-4180-95e7-46ee05f1be52" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-f13ab070-1b7a-4180-95e7-46ee05f1be52" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[17228646-ee94-4506-ad42-1e809ba45163]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:28 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609 1073741824" returned: 0 in 0.617s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:28 devstack sudo[89157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52
Apr 16 02:41:28 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:28 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609
Apr 16 02:41:28 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:28 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.500s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Deleted volume successfully.
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-73748489-69ba-41b4-8f48-05e1d3b4c0ef tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-591bb122-2eee-47e5-ac62-32efc1c5f3b3-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:28 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52" returned: 0 in 0.537s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:28 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:28 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52
Apr 16 02:41:28 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3135a3a4-663c-450e-8943-60605aabe9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937a08ea-a82a-4d24-a3f3-62dc5de47609', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d0af6f-2b63-4ad5-9009-7d4d74a61e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:28 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Volume volume-937a08ea-a82a-4d24-a3f3-62dc5de47609 (937a08ea-a82a-4d24-a3f3-62dc5de47609): created successfully
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d0af6f-2b63-4ad5-9009-7d4d74a61e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Flow 'volume_create_manager' (54b35036-be35-4ca9-83a9-0397f61fd80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-76f6d174-7b34-4e8d-9653-13bd66ecce0d tempest-VolumesTransfersV355Test-54796805 None] Created volume successfully.
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-089ad9bc-c58a-43f3-9826-3a522f68451c-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-089ad9bc-c58a-43f3-9826-3a522f68451c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-quobyte-089ad9bc-c58a-43f3-9826-3a522f68451c" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-089ad9bc-c58a-43f3-9826-3a522f68451c" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f82031-d4a7-493c-869b-f662f50e92c0]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:29 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f13ab070-1b7a-4180-95e7-46ee05f1be52" returned: 0 in 0.470s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-f13ab070-1b7a-4180-95e7-46ee05f1be52" released by "delete_volume" :: held 1.036s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Created reservations ['4063bced-9aac-451d-8240-4b802d4a90da', '5c58eedb-6acc-4790-bc05-91300b8bcea7', 'b050f5a6-cf92-4922-bfbe-bc6f556c8563', '397f807d-831e-4111-baa2-902f1c5344fa'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:29 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c
Apr 16 02:41:29 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:29 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:29 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Acquiring lock "cinder-937a08ea-a82a-4d24-a3f3-62dc5de47609-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-937a08ea-a82a-4d24-a3f3-62dc5de47609-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Acquiring lock "cinder-quobyte-937a08ea-a82a-4d24-a3f3-62dc5de47609" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-quobyte-937a08ea-a82a-4d24-a3f3-62dc5de47609" acquired by "delete_volume" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0fe19d-0a89-4712-bc1f-c4dcee8a698a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:29 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c" returned: 0 in 0.527s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:29 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c
Apr 16 02:41:29 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:29 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609
Apr 16 02:41:29 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:29 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.481s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:29 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Deleted volume successfully.
Apr 16 02:41:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89e7e72a-afa4-4bf0-83d0-c3766b580cfa tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-f13ab070-1b7a-4180-95e7-46ee05f1be52-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:30 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-089ad9bc-c58a-43f3-9826-3a522f68451c" returned: 0 in 0.452s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-089ad9bc-c58a-43f3-9826-3a522f68451c" released by "delete_volume" :: held 1.018s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:30 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609" returned: 0 in 0.535s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created reservations ['120ca5a1-c59a-4cb7-9e8b-6d3cf4a57bc7', '3100bbc1-c8ab-4c26-b379-2e4eada98f1a', '7687f622-a2eb-4fd8-a247-3ea86f7607dd', 'f572057f-2a7e-4fd2-b49f-44e3c9a64b70'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:30 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609
Apr 16 02:41:30 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:30 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:30 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-4aa49fdc-286c-4347-8c7c-324d9089b6e1-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-4aa49fdc-286c-4347-8c7c-324d9089b6e1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-quobyte-4aa49fdc-286c-4347-8c7c-324d9089b6e1" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-4aa49fdc-286c-4347-8c7c-324d9089b6e1" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670b5a7-8082-41d3-b844-0ecf24e30da1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:30 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1
Apr 16 02:41:30 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:30 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-937a08ea-a82a-4d24-a3f3-62dc5de47609" returned: 0 in 0.548s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-quobyte-937a08ea-a82a-4d24-a3f3-62dc5de47609" released by "delete_volume" :: held 1.119s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Created reservations ['5b89d197-c2b3-4245-a13a-02c4e895fbfa', 'f9597460-bdec-4615-bb1f-c2b67eedff7f', '509cd4e9-d8bf-4575-bc3e-75075c4715ea', '0a2fbbf0-2674-42f8-8e57-89da7a042a15'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:30 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:30 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:31 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.618s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Deleted volume successfully.
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8b247252-f94a-4ccd-94d0-944fdfac6dac tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-089ad9bc-c58a-43f3-9826-3a522f68451c-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:31 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1" returned: 0 in 0.608s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:31 devstack sudo[89198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1
Apr 16 02:41:31 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-4f4c94f4-26ab-44db-aab8-41e6727beec7-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-4f4c94f4-26ab-44db-aab8-41e6727beec7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "cinder-quobyte-4f4c94f4-26ab-44db-aab8-41e6727beec7" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-4f4c94f4-26ab-44db-aab8-41e6727beec7" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b1120f-999e-49c6-a79c-d8e812e9dfd0]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:31 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.563s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Deleted volume successfully.
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b2dd88d2-0461-4f32-831c-4b55d64160f7 tempest-VolumesTransfersV355Test-1567042674 None] Lock "cinder-937a08ea-a82a-4d24-a3f3-62dc5de47609-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:31 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7
Apr 16 02:41:31 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:31 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4aa49fdc-286c-4347-8c7c-324d9089b6e1" returned: 0 in 0.552s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-4aa49fdc-286c-4347-8c7c-324d9089b6e1" released by "delete_volume" :: held 1.189s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Created reservations ['b44672d8-a4d3-4e18-a8ae-9bf7122cab5c', 'c7db93c1-032c-4cc7-92b3-24e656248d04', '25e56717-d225-433a-894f-b4f2cce45f67', 'c6526f3f-9c04-44fe-9c1c-a2dabe5408d5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:31 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:31 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7" returned: 0 in 0.612s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:32 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:32 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7
Apr 16 02:41:32 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:32 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.514s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:32 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Deleted volume successfully.
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-fda115b2-7748-4f1b-8fc9-f044ad9e9bed tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-4aa49fdc-286c-4347-8c7c-324d9089b6e1-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:32 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4f4c94f4-26ab-44db-aab8-41e6727beec7" returned: 0 in 0.581s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-quobyte-4f4c94f4-26ab-44db-aab8-41e6727beec7" released by "delete_volume" :: held 1.218s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-d05b17eb-37da-4652-aaae-1fe81ce0e9e8-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Created reservations ['a7458828-df82-4ad8-a81d-1aabbdc3a619', 'c9bcaa4c-9c8e-4d07-ac88-2004c067f7cd', '06f04ef6-af8b-4f96-a525-5545d9d46e99', '05408971-ac94-4318-b9bd-c1c424906ade'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-d05b17eb-37da-4652-aaae-1fe81ce0e9e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-quobyte-d05b17eb-37da-4652-aaae-1fe81ce0e9e8" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-d05b17eb-37da-4652-aaae-1fe81ce0e9e8" acquired by "delete_volume" :: waited 0.026s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e2f0a-9978-4f5a-8726-e1e45a3311d1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:32 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:32 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:32 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8
Apr 16 02:41:32 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:33 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.598s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:33 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:33 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8" returned: 0 in 0.593s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:33 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Deleted volume successfully.
Apr 16 02:41:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8a91c35e-0bcc-4afa-ae61-cc0a8b5b4197 tempest-CreateVolumesFromSourceVolumeTest-146922197 None] Lock "cinder-4f4c94f4-26ab-44db-aab8-41e6727beec7-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:33 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8
Apr 16 02:41:33 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:33 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d05b17eb-37da-4652-aaae-1fe81ce0e9e8" returned: 0 in 0.586s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-d05b17eb-37da-4652-aaae-1fe81ce0e9e8" released by "delete_volume" :: held 1.216s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Created reservations ['80677695-b0ce-4612-ac20-8fd8e66871d4', '4595f7dc-4176-421b-b1de-dcac75576baa', '028a848b-51bb-43b6-940a-13990e39fc44', 'cb7c18cc-2f33-4f3a-9243-70c0b790e4c3'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:34 devstack sudo[89226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:34 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:34 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.632s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:34 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Deleted volume successfully.
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dbb431a0-d79b-4d71-9ac3-b8cc7bc7481b tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-d05b17eb-37da-4652-aaae-1fe81ce0e9e8-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-002b64ee-a2bd-4b22-ace4-69e66254359f-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-002b64ee-a2bd-4b22-ace4-69e66254359f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-quobyte-002b64ee-a2bd-4b22-ace4-69e66254359f" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-002b64ee-a2bd-4b22-ace4-69e66254359f" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6f09f-944f-44e0-8735-89c29dd01629]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:35 devstack sudo[89232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f
Apr 16 02:41:35 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:35 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f" returned: 0 in 0.596s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:35 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f
Apr 16 02:41:35 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Flow 'volume_create_manager' (3f77c64d-92cc-42b8-8362-16c8ba40a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d618d47-ef0f-4f72-bf11-210711130638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d618d47-ef0f-4f72-bf11-210711130638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1710752357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e53904-0935-421e-950c-abce5e155b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc1e9c7bd7c4e2f9857bae7b931545b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:36Z,use_quota=True,user_id='a54f6038fb7342d4afddb6f15c67e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4667414-6fff-4ead-88ed-bcb6805da752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4667414-6fff-4ead-88ed-bcb6805da752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783d7c25-c802-4a0c-88aa-9b099930fec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783d7c25-c802-4a0c-88aa-9b099930fec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e53904-0935-421e-950c-abce5e155b3a', 'volume_name': 'volume-f6e53904-0935-421e-950c-abce5e155b3a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183b4a31-5cb9-44be-bce0-2ae6a31d1c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183b4a31-5cb9-44be-bce0-2ae6a31d1c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6dfa65-66c2-4e0b-8302-c99bde65f472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:35 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Volume f6e53904-0935-421e-950c-abce5e155b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e53904-0935-421e-950c-abce5e155b3a', 'volume_size': 1}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1710752357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e53904-0935-421e-950c-abce5e155b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc1e9c7bd7c4e2f9857bae7b931545b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:36Z,use_quota=True,user_id='a54f6038fb7342d4afddb6f15c67e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Creating volume f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:35 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:36 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a 1073741824
Apr 16 02:41:36 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:36 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-002b64ee-a2bd-4b22-ace4-69e66254359f" returned: 0 in 0.467s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-002b64ee-a2bd-4b22-ace4-69e66254359f" released by "delete_volume" :: held 1.088s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Created reservations ['0d891f8e-f0b6-4230-a017-31ae1be68444', 'f0beddb2-1ce3-4945-b9e1-43deb4194a1b', 'e16bb10e-c54c-40ba-85e5-d0ab9579abe2', 'cc8d04ec-193a-4c2f-aefc-437c96e067a3'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:36 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:36 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:36 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a 1073741824" returned: 0 in 0.607s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:36 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.479s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:36 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a
Apr 16 02:41:36 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:36 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Deleted volume successfully.
Apr 16 02:41:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3695ed33-352a-415e-81e8-f6c506b828af tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-002b64ee-a2bd-4b22-ace4-69e66254359f-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Flow 'volume_create_manager' (c97d93ee-6723-4a6a-82f0-88b393d16456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35df8db-6d8d-4f35-b356-c1f77fe83aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35df8db-6d8d-4f35-b356-c1f77fe83aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-693880387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8527f36-241b-4920-ae45-0c46c1172027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e2bbe7d3004d25a793929aaebc123a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:37Z,use_quota=True,user_id='a1dafc8a018c4836b014d985d73a9f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd81ed78-1cfb-49f2-a55a-04f1b14e3cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd81ed78-1cfb-49f2-a55a-04f1b14e3cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19deff26-ae72-41b9-9a5f-5d9384e1b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19deff26-ae72-41b9-9a5f-5d9384e1b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8527f36-241b-4920-ae45-0c46c1172027', 'volume_name': 'volume-d8527f36-241b-4920-ae45-0c46c1172027', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d759e91-5aca-45c2-ae98-62abd7014e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d759e91-5aca-45c2-ae98-62abd7014e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ac5761-4f65-4ca8-86df-0a41bda3ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:37 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Volume d8527f36-241b-4920-ae45-0c46c1172027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8527f36-241b-4920-ae45-0c46c1172027', 'volume_size': 1}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-602c3c62-e814-4338-b084-2acc4993f3d9-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-602c3c62-e814-4338-b084-2acc4993f3d9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:37 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a" returned: 0 in 0.513s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-693880387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8527f36-241b-4920-ae45-0c46c1172027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e2bbe7d3004d25a793929aaebc123a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:37Z,use_quota=True,user_id='a1dafc8a018c4836b014d985d73a9f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Creating volume d8527f36-241b-4920-ae45-0c46c1172027 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:37 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6dfa65-66c2-4e0b-8302-c99bde65f472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e53904-0935-421e-950c-abce5e155b3a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bd2082-8871-45c7-b109-1af5f4771ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:37 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027 1073741824
Apr 16 02:41:37 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:37 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Volume volume-f6e53904-0935-421e-950c-abce5e155b3a (f6e53904-0935-421e-950c-abce5e155b3a): created successfully
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bd2082-8871-45c7-b109-1af5f4771ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Flow 'volume_create_manager' (3f77c64d-92cc-42b8-8362-16c8ba40a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-3b7cdf3d-bc36-4a05-bec7-f6e0089b9ccb req-67c16614-8b06-443b-8126-5d2273c92fdc tempest-VolumesSnapshotsTestJSON-651057818 None] Created volume successfully.
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "cinder-quobyte-602c3c62-e814-4338-b084-2acc4993f3d9" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-602c3c62-e814-4338-b084-2acc4993f3d9" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[784c2946-9ee1-4290-b56d-360ca6a0912b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:37 devstack sudo[89253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9
Apr 16 02:41:37 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:37 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027 1073741824" returned: 0 in 0.527s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:37 devstack sudo[89261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027
Apr 16 02:41:37 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:37 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9" returned: 0 in 0.552s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:37 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9
Apr 16 02:41:37 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:38 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027" returned: 0 in 0.515s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ac5761-4f65-4ca8-86df-0a41bda3ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8527f36-241b-4920-ae45-0c46c1172027', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ce529f-b7c1-41b1-8e05-58d08b8b1e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:38 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Creating offline snapshot b9ea3d86-bb1a-4923-8ce2-6472a5546796 of volume f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:41:38 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Volume volume-d8527f36-241b-4920-ae45-0c46c1172027 (d8527f36-241b-4920-ae45-0c46c1172027): created successfully
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ce529f-b7c1-41b1-8e05-58d08b8b1e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Flow 'volume_create_manager' (c97d93ee-6723-4a6a-82f0-88b393d16456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-602c3c62-e814-4338-b084-2acc4993f3d9" returned: 0 in 0.558s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[109b8655-e93f-4b25-8ade-98417f170f48]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f01708f6-7838-4932-91ca-9b6aff851cb1 tempest-VolumesTransfersV357Test-1797590129 None] Created volume successfully.
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-quobyte-602c3c62-e814-4338-b084-2acc4993f3d9" released by "delete_volume" :: held 1.153s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Created reservations ['186c6f85-fec6-4a2c-8b04-144e254e0cef', 'b4162afc-598e-4290-aa35-6c6fa642c3b8', '0e833291-9c0b-4f9f-8276-a2a06e8749d5', '5c2e0c64-c83f-44f1-8452-a6e02d422397'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:38 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a
Apr 16 02:41:38 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:38 devstack sudo[89269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:38 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:38 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a" returned: 0 in 0.533s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:38 devstack sudo[89275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 1G
Apr 16 02:41:38 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:38 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Deleted volume successfully.
Apr 16 02:41:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1ddbb11-1466-4c37-9da8-93365ba60fbf tempest-CreateVolumesFromImageTest-924722493 None] Lock "cinder-602c3c62-e814-4338-b084-2acc4993f3d9-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:39 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 1G" returned: 0 in 0.570s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e53904-0935-421e-950c-abce5e155b3a -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:39 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e53904-0935-421e-950c-abce5e155b3a -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796
Apr 16 02:41:39 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2230a7fc-fab4-42f8-921e-8669728c3d34 tempest-VolumesTransfersV357Test-1932485090 None] Transfer volume completed successfully.
Apr 16 02:41:40 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e53904-0935-421e-950c-abce5e155b3a -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796" returned: 0 in 0.544s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:40 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 is being set with open permissions: ugo+rw
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:40 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796
Apr 16 02:41:40 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:40 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:40 devstack sudo[89288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.info
Apr 16 02:41:40 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Acquiring lock "cinder-d8527f36-241b-4920-ae45-0c46c1172027-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-d8527f36-241b-4920-ae45-0c46c1172027-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Acquiring lock "cinder-quobyte-d8527f36-241b-4920-ae45-0c46c1172027" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-quobyte-d8527f36-241b-4920-ae45-0c46c1172027" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86dfedd-5508-4f79-bd93-9327a2d768b1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:40 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027
Apr 16 02:41:40 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:41 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.info" returned: 0 in 0.528s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:41 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.info is being set with open permissions: ugo+rw
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:41 devstack sudo[89293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.info
Apr 16 02:41:41 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (7842967f-e79b-4521-91d9-e294e8a225a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a115cc-6951-458f-afb7-6d13c40582b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a115cc-6951-458f-afb7-6d13c40582b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72876901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be12ff49-627a-45cf-a70a-b357c034cad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b0e9acbcf4a868e6f403a0f9a286d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:41Z,use_quota=True,user_id='d2f6b4bee7d644bb903cd9fd41eca0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdd9ba2-09c7-4706-ae4d-c457fea25d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdd9ba2-09c7-4706-ae4d-c457fea25d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abba9bd-ea88-479d-8db5-bba53b5057b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4abba9bd-ea88-479d-8db5-bba53b5057b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be12ff49-627a-45cf-a70a-b357c034cad2', 'volume_name': 'volume-be12ff49-627a-45cf-a70a-b357c034cad2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25270cde-8030-4efa-b187-1194b17cf506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25270cde-8030-4efa-b187-1194b17cf506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097c096a-06f6-4a6b-8ad5-75e26f8705e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:41 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Volume be12ff49-627a-45cf-a70a-b357c034cad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be12ff49-627a-45cf-a70a-b357c034cad2', 'volume_size': 1}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:41 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027" returned: 0 in 0.588s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:41 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027
Apr 16 02:41:41 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:41 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.info" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.228s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72876901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be12ff49-627a-45cf-a70a-b357c034cad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b0e9acbcf4a868e6f403a0f9a286d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:41Z,use_quota=True,user_id='d2f6b4bee7d644bb903cd9fd41eca0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Creating volume be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:41 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:41 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 1073741824
Apr 16 02:41:41 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:41 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-672fc288-5db5-4b6c-a9ed-e773715a8264 req-769831b0-dd38-441c-ab7b-efe9a33de6fd tempest-VolumesSnapshotsTestJSON-651057818 None] Create snapshot completed successfully
Apr 16 02:41:41 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d8527f36-241b-4920-ae45-0c46c1172027" returned: 0 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-quobyte-d8527f36-241b-4920-ae45-0c46c1172027" released by "delete_volume" :: held 1.081s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "cinder-b9ea3d86-bb1a-4923-8ce2-6472a5546796-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-b9ea3d86-bb1a-4923-8ce2-6472a5546796-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "cinder-quobyte-f6e53904-0935-421e-950c-abce5e155b3a" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-quobyte-f6e53904-0935-421e-950c-abce5e155b3a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "cinder-quobyte-b9ea3d86-bb1a-4923-8ce2-6472a5546796" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-quobyte-b9ea3d86-bb1a-4923-8ce2-6472a5546796" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Deleting offline snapshot b9ea3d86-bb1a-4923-8ce2-6472a5546796 of volume f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] snapshot_file for this snap is: volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c7697-606c-4a43-9dd2-b1f92beacfa6]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Created reservations ['86d591b8-e1c9-4f15-9028-a3ea0bc449b3', '8ffdc943-fdff-457e-843f-d97c0bdb3974', '672a5eb9-2136-4b6f-82a2-8728cd684764', 'd499f50b-963c-4f3e-809c-d31709c65e38'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:41 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796
Apr 16 02:41:41 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:41 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:41 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:42 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 1073741824" returned: 0 in 0.550s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:42 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2
Apr 16 02:41:42 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:42 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.443s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:42 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Deleted volume successfully.
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7e6ee375-8269-4acf-8eb8-5cdd719a0a56 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-d8527f36-241b-4920-ae45-0c46c1172027-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:42 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796" returned: 0 in 0.526s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6e53904-0935-421e-950c-abce5e155b3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf574e86-65e5-41f8-ae50-789461c3c6c8]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:42 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a
Apr 16 02:41:42 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:42 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2" returned: 0 in 0.441s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097c096a-06f6-4a6b-8ad5-75e26f8705e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be12ff49-627a-45cf-a70a-b357c034cad2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27931ee-8c4d-40d3-9fc4-e2e031b6245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:42 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Volume volume-be12ff49-627a-45cf-a70a-b357c034cad2 (be12ff49-627a-45cf-a70a-b357c034cad2): created successfully
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27931ee-8c4d-40d3-9fc4-e2e031b6245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (7842967f-e79b-4521-91d9-e294e8a225a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:42 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-cce25c00-a8b7-454f-bd14-830aac731f6a tempest-VolumeDependencyTests-254074194 None] Created volume successfully.
Apr 16 02:41:42 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a" returned: 0 in 0.522s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:42 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796
Apr 16 02:41:42 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Flow 'volume_create_manager' (bf8abd12-15b1-4920-b928-4c3ba245e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7530fb-0a68-435b-9cad-0a2257090ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7530fb-0a68-435b-9cad-0a2257090ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954979012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1f0352-e91c-4963-9ffa-05e2f0bd2f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e2bbe7d3004d25a793929aaebc123a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:43Z,use_quota=True,user_id='a1dafc8a018c4836b014d985d73a9f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6272bf23-f86c-45e4-9ce1-00a26085520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6272bf23-f86c-45e4-9ce1-00a26085520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f13b9f-ebe8-4358-b80d-d79f825daacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f13b9f-ebe8-4358-b80d-d79f825daacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1f0352-e91c-4963-9ffa-05e2f0bd2f74', 'volume_name': 'volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50769c98-a9f3-47e9-8fd3-bd5fe81114c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50769c98-a9f3-47e9-8fd3-bd5fe81114c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec2295-a8d7-4f1c-8bf5-104006c2872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:43 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Volume be1f0352-e91c-4963-9ffa-05e2f0bd2f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74', 'volume_size': 1}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954979012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1f0352-e91c-4963-9ffa-05e2f0bd2f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e2bbe7d3004d25a793929aaebc123a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:43Z,use_quota=True,user_id='a1dafc8a018c4836b014d985d73a9f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Creating volume be1f0352-e91c-4963-9ffa-05e2f0bd2f74 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:43 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:43 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74 1073741824
Apr 16 02:41:43 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:43 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796" returned: 0 in 0.504s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:43 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796
Apr 16 02:41:43 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:43 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74 1073741824" returned: 0 in 0.536s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:43 devstack sudo[89335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74
Apr 16 02:41:43 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:43 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a.b9ea3d86-bb1a-4923-8ce2-6472a5546796" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-quobyte-b9ea3d86-bb1a-4923-8ce2-6472a5546796" released by "_delete_snapshot" :: held 2.098s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-quobyte-f6e53904-0935-421e-950c-abce5e155b3a" released by "delete_snapshot" :: held 2.113s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.quota [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Created reservations ['0fef870e-bcca-437b-874c-3b5f6ffafcc0', '42edc2e8-6472-43ec-80b2-97176bfe261b', 'dca50d22-06e7-476a-aa37-afcc1860157f', '377e7761-36d3-4761-a618-3c71a7d148af'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Delete snapshot completed successfully.
Apr 16 02:41:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-0df2553f-8a19-4d25-a17b-c07223b55771 req-a4e8caea-63f0-4ec1-8a25-5060017f9aa3 tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-b9ea3d86-bb1a-4923-8ce2-6472a5546796-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:44 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74" returned: 0 in 0.440s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.695s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec2295-a8d7-4f1c-8bf5-104006c2872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdaf835-d8b8-4a0b-b151-2954291d3503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Creating offline snapshot b48f2367-30a5-426c-9f07-74c2ebc9b880 of volume be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:41:44 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Volume volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74 (be1f0352-e91c-4963-9ffa-05e2f0bd2f74): created successfully
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdaf835-d8b8-4a0b-b151-2954291d3503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Flow 'volume_create_manager' (bf8abd12-15b1-4920-b928-4c3ba245e11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa49ea57-ad32-4fcb-afc4-8aa48dce6d0b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:44 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c27f2b22-745c-4f55-8540-07d165f6f14e tempest-VolumesTransfersV357Test-1797590129 None] Created volume successfully.
Apr 16 02:41:44 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2
Apr 16 02:41:44 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:44 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2" returned: 0 in 0.489s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:44 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 1G
Apr 16 02:41:44 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "cinder-f6e53904-0935-421e-950c-abce5e155b3a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-f6e53904-0935-421e-950c-abce5e155b3a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "cinder-quobyte-f6e53904-0935-421e-950c-abce5e155b3a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-quobyte-f6e53904-0935-421e-950c-abce5e155b3a" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0d553d-f671-4c6c-9ac6-3432d9c8ba4f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:45 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a
Apr 16 02:41:45 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:45 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 1G" returned: 0 in 0.556s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be12ff49-627a-45cf-a70a-b357c034cad2 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:45 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be12ff49-627a-45cf-a70a-b357c034cad2 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880
Apr 16 02:41:45 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Acquiring lock "cinder-be1f0352-e91c-4963-9ffa-05e2f0bd2f74-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-be1f0352-e91c-4963-9ffa-05e2f0bd2f74-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Acquiring lock "cinder-quobyte-be1f0352-e91c-4963-9ffa-05e2f0bd2f74" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-quobyte-be1f0352-e91c-4963-9ffa-05e2f0bd2f74" acquired by "delete_volume" :: waited 0.026s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd518785-6169-4165-b92f-fb7ee7ceb1f1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:45 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74
Apr 16 02:41:45 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:45 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a" returned: 0 in 0.576s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:45 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a
Apr 16 02:41:45 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:45 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be12ff49-627a-45cf-a70a-b357c034cad2 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880" returned: 0 in 0.485s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:45 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 is being set with open permissions: ugo+rw
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:45 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880
Apr 16 02:41:45 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:45 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74" returned: 0 in 0.493s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:45 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74
Apr 16 02:41:45 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:46 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f6e53904-0935-421e-950c-abce5e155b3a" returned: 0 in 0.454s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-quobyte-f6e53904-0935-421e-950c-abce5e155b3a" released by "delete_volume" :: held 1.067s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.quota [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Created reservations ['94999180-5e15-4564-8817-0396594c80cb', '2d15bd82-b213-4f33-a10b-0fa98355cc61', '5ecb517c-bb61-42fa-868d-daced87a1543', '7cad8f2c-d2b7-4949-a545-ef13b45947f6'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:46 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880" returned: 0 in 0.485s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:46 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.info
Apr 16 02:41:46 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:46 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:46 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:46 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be1f0352-e91c-4963-9ffa-05e2f0bd2f74" returned: 0 in 0.475s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-quobyte-be1f0352-e91c-4963-9ffa-05e2f0bd2f74" released by "delete_volume" :: held 0.993s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Created reservations ['67999315-7ede-4a6d-8adf-1ce42543ce9b', '60a075cf-e832-4fe3-82f9-ecd313eb6cd6', 'a4349540-ab9f-422c-a2d1-7e617f14a282', '23cc25bf-c0d1-47ff-a42b-f20bb266b92e'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:46 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:46 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:46 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.info" returned: 0 in 0.459s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:46 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.info is being set with open permissions: ugo+rw
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:46 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.info
Apr 16 02:41:46 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:46 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.475s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.manager [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:46 devstack cinder-volume[83205]: INFO cinder.volume.manager [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Deleted volume successfully.
Apr 16 02:41:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [req-84e63a7b-79fb-4896-83bc-746779383354 req-61434db3-39ae-407c-bce8-effdc8fc913f tempest-VolumesSnapshotsTestJSON-651057818 None] Lock "cinder-f6e53904-0935-421e-950c-abce5e155b3a-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:47 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.432s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:47 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Deleted volume successfully.
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d934a53e-60ee-48a0-92df-6fd073024000 tempest-VolumesTransfersV357Test-868292232 None] Lock "cinder-be1f0352-e91c-4963-9ffa-05e2f0bd2f74-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:47 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.info" returned: 0 in 0.449s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.017s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:47 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ec0e2aee-8d36-4938-8902-13aa5cd37aba tempest-VolumeDependencyTests-254074194 None] Create snapshot completed successfully
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (8e383267-327b-4381-8bfd-f40d590de159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a7ac3e-746a-41e2-8e4e-ea9e6933dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a7ac3e-746a-41e2-8e4e-ea9e6933dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2089996407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f01e5fd-cf36-447f-bd43-1dc860995361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b0e9acbcf4a868e6f403a0f9a286d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b48f2367-30a5-426c-9f07-74c2ebc9b880,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:48Z,use_quota=True,user_id='d2f6b4bee7d644bb903cd9fd41eca0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8049f063-3011-4ce1-be1b-b66883718ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8049f063-3011-4ce1-be1b-b66883718ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89451db2-b223-411e-9463-4aff64894f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89451db2-b223-411e-9463-4aff64894f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f01e5fd-cf36-447f-bd43-1dc860995361', 'volume_name': 'volume-0f01e5fd-cf36-447f-bd43-1dc860995361', 'volume_size': 1, 'snapshot_id': 'b48f2367-30a5-426c-9f07-74c2ebc9b880'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd5207f-e413-4c34-bdbe-506aa7743d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd5207f-e413-4c34-bdbe-506aa7743d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4a81f3-cb05-4a72-9e01-25598b5cd216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:47 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Volume 0f01e5fd-cf36-447f-bd43-1dc860995361: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f01e5fd-cf36-447f-bd43-1dc860995361', 'volume_size': 1, 'snapshot_id': 'b48f2367-30a5-426c-9f07-74c2ebc9b880'}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-b48f2367-30a5-426c-9f07-74c2ebc9b880-0f01e5fd-cf36-447f-bd43-1dc860995361" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-b48f2367-30a5-426c-9f07-74c2ebc9b880-0f01e5fd-cf36-447f-bd43-1dc860995361" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Creating volume 0f01e5fd-cf36-447f-bd43-1dc860995361 from snapshot b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-0f01e5fd-cf36-447f-bd43-1dc860995361" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-0f01e5fd-cf36-447f-bd43-1dc860995361" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] snapshot: b48f2367-30a5-426c-9f07-74c2ebc9b880, volume: 0f01e5fd-cf36-447f-bd43-1dc860995361,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3061b6-ad04-42bc-90c3-f32b3d74c282]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:48 devstack sudo[89386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880
Apr 16 02:41:48 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:48 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880" returned: 0 in 0.563s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be12ff49-627a-45cf-a70a-b357c034cad2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf32215-c83f-46cc-a956-6154718b5cd6]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:48 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2
Apr 16 02:41:48 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:49 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2" returned: 0 in 0.559s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:49 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:41:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:49 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361
Apr 16 02:41:49 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:50 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-503baeec-0408-41f7-978b-5686d6e71e9f tempest-GroupsTest-779903123 None] Group tempest-Group1-2146343530: creating
Apr 16 02:41:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-503baeec-0408-41f7-978b-5686d6e71e9f tempest-GroupsTest-779903123 None] Group tempest-Group1-2146343530: created successfully
Apr 16 02:41:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-503baeec-0408-41f7-978b-5686d6e71e9f tempest-GroupsTest-779903123 None] Create group completed successfully.
Apr 16 02:41:51 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361" returned: 0 in 2.525s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:51 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b547941-42bf-4c29-bab3-32084d1169f2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:51 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2
Apr 16 02:41:51 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a08893ef-abea-461f-894b-3c9b5b3fca2c tempest-GroupsTest-779903123 None] Group tempest-Group2-1458950575: creating
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a08893ef-abea-461f-894b-3c9b5b3fca2c tempest-GroupsTest-779903123 None] Group tempest-Group2-1458950575: created successfully
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a08893ef-abea-461f-894b-3c9b5b3fca2c tempest-GroupsTest-779903123 None] Create group completed successfully.
Apr 16 02:41:52 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2" returned: 0 in 0.663s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Converted 1024.00 MB image at 405.45 MB/s
Apr 16 02:41:52 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361 is being set with open permissions: ugo+rw
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:52 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361
Apr 16 02:41:52 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (0882264a-165e-42ec-8258-ddff5287bd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab92180-498a-45de-8921-7e68fd7691aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab92180-498a-45de-8921-7e68fd7691aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1889324267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:52Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cb70f6-c78d-4194-ba5c-80395d1d21f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cb70f6-c78d-4194-ba5c-80395d1d21f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053d4b79-9e84-4d9d-9966-23092728e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053d4b79-9e84-4d9d-9966-23092728e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854', 'volume_name': 'volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e37174-7852-4e43-bf34-c2bdc4e2369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e37174-7852-4e43-bf34-c2bdc4e2369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf482b29-5e48-4f50-845f-c97047b1d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Volume 4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854', 'volume_size': 1}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:52 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361" returned: 0 in 0.429s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-0f01e5fd-cf36-447f-bd43-1dc860995361" released by "_copy_volume_from_snapshot" :: held 4.806s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-b48f2367-30a5-426c-9f07-74c2ebc9b880-0f01e5fd-cf36-447f-bd43-1dc860995361" released by "_create_volume_from_snapshot" :: held 4.824s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.836s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.249s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1889324267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:52Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Creating volume 4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:52 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 1073741824
Apr 16 02:41:52 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4a81f3-cb05-4a72-9e01-25598b5cd216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f01e5fd-cf36-447f-bd43-1dc860995361', 'volume_size': 1, 'snapshot_id': 'b48f2367-30a5-426c-9f07-74c2ebc9b880'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053c51ae-c0f5-499e-8af9-a305281f010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Volume volume-0f01e5fd-cf36-447f-bd43-1dc860995361 (0f01e5fd-cf36-447f-bd43-1dc860995361): created successfully
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053c51ae-c0f5-499e-8af9-a305281f010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:52 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (8e383267-327b-4381-8bfd-f40d590de159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:52 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-9f11414d-9f2f-41ad-afbf-cc5c5eafb0e2 tempest-VolumeDependencyTests-254074194 None] Created volume successfully.
Apr 16 02:41:53 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 1073741824" returned: 0 in 0.505s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-b48f2367-30a5-426c-9f07-74c2ebc9b880-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-b48f2367-30a5-426c-9f07-74c2ebc9b880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-be12ff49-627a-45cf-a70a-b357c034cad2" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:53 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854
Apr 16 02:41:53 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-be12ff49-627a-45cf-a70a-b357c034cad2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-b48f2367-30a5-426c-9f07-74c2ebc9b880" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-b48f2367-30a5-426c-9f07-74c2ebc9b880" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Deleting offline snapshot b48f2367-30a5-426c-9f07-74c2ebc9b880 of volume be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] snapshot_file for this snap is: volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c0e20-5956-40ea-b277-a1d85e6842ab]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:53 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880
Apr 16 02:41:53 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Flow 'volume_create_manager' (a9f1926e-6d51-4800-b68f-00a2d3d07cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b039b6-e4d3-40cf-95bb-7eb468027724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b039b6-e4d3-40cf-95bb-7eb468027724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517857343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8312e885-f0d1-4e83-ba26-60417247c4da,host='devstack@QuobyteHD#QuobyteHD',id=0e7a6f20-50f6-4a95-8930-349185e1994a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e7407c006d46099891bc2f71f21433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:54Z,use_quota=True,user_id='e0f7b20bf9c94f24896dc95c48dd860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6399251e-6fb4-46f7-959a-c051a01b677b),volume_type_id=6399251e-6fb4-46f7-959a-c051a01b677b)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3b7be2-b699-49f7-9437-9f84193a40e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3b7be2-b699-49f7-9437-9f84193a40e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a612cc-39f3-45e6-8e2b-db193eea1aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a612cc-39f3-45e6-8e2b-db193eea1aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7a6f20-50f6-4a95-8930-349185e1994a', 'volume_name': 'volume-0e7a6f20-50f6-4a95-8930-349185e1994a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a228df3b-7954-43f6-99b8-7e283d0d4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a228df3b-7954-43f6-99b8-7e283d0d4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa700e28-8167-4407-a8ec-c32901b1a09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:53 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Volume 0e7a6f20-50f6-4a95-8930-349185e1994a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7a6f20-50f6-4a95-8930-349185e1994a', 'volume_size': 1}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:53 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854" returned: 0 in 0.500s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8312e885-f0d1-4e83-ba26-60417247c4da,created_at=2026-04-16T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517857343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8312e885-f0d1-4e83-ba26-60417247c4da,host='devstack@QuobyteHD#QuobyteHD',id=0e7a6f20-50f6-4a95-8930-349185e1994a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e7407c006d46099891bc2f71f21433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:54Z,use_quota=True,user_id='e0f7b20bf9c94f24896dc95c48dd860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6399251e-6fb4-46f7-959a-c051a01b677b),volume_type_id=6399251e-6fb4-46f7-959a-c051a01b677b)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Creating volume 0e7a6f20-50f6-4a95-8930-349185e1994a {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:53 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf482b29-5e48-4f50-845f-c97047b1d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:53 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a 1073741824
Apr 16 02:41:53 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc301f5-6207-494c-b367-aa0251cdc5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:53 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Volume volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 (4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854): created successfully
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc301f5-6207-494c-b367-aa0251cdc5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (0882264a-165e-42ec-8258-ddff5287bd29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1115f0e2-be7d-4703-9d56-4df7fc1b6271 tempest-VolumesGetTest-1962211217 None] Created volume successfully.
Apr 16 02:41:53 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880" returned: 0 in 0.525s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be12ff49-627a-45cf-a70a-b357c034cad2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4d449-b822-42ad-8944-a71ef7d5e2a4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:54 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2
Apr 16 02:41:54 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:54 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a 1073741824" returned: 0 in 0.487s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:54 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a
Apr 16 02:41:54 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:54 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2" returned: 0 in 0.524s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:54 devstack sudo[89447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880
Apr 16 02:41:54 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:54 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa700e28-8167-4407-a8ec-c32901b1a09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7a6f20-50f6-4a95-8930-349185e1994a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b81e4-a36a-4efe-afe4-3c3984dd32ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:54 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Volume volume-0e7a6f20-50f6-4a95-8930-349185e1994a (0e7a6f20-50f6-4a95-8930-349185e1994a): created successfully
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566b81e4-a36a-4efe-afe4-3c3984dd32ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Flow 'volume_create_manager' (a9f1926e-6d51-4800-b68f-00a2d3d07cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:54 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c9638a7f-d6c1-484d-92f1-81222beeb979 tempest-GroupsTest-779903123 None] Created volume successfully.
Apr 16 02:41:54 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880" returned: 0 in 0.514s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:55 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880
Apr 16 02:41:55 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (23f2fd96-1465-42cb-aaed-88734864f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830e4f6d-d15d-495a-99fc-0fa9b841fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830e4f6d-d15d-495a-99fc-0fa9b841fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-360028458',display_name='tempest-VolumesGetTest-Volume-1880952879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c471c4-8397-4093-81f3-9ff5c5f18e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:55Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560e811b-d1d4-4748-88c9-2a33152416b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560e811b-d1d4-4748-88c9-2a33152416b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da463d0-7028-46b6-a3eb-584b56a7dca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da463d0-7028-46b6-a3eb-584b56a7dca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c471c4-8397-4093-81f3-9ff5c5f18e3d', 'volume_name': 'volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903ff42-4fdd-4652-9433-a6b0a6951669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903ff42-4fdd-4652-9433-a6b0a6951669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1ebcdf-f7f2-44a6-81de-cf36f496703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:55 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Volume 82c471c4-8397-4093-81f3-9ff5c5f18e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d', 'volume_size': 1}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-360028458',display_name='tempest-VolumesGetTest-Volume-1880952879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c471c4-8397-4093-81f3-9ff5c5f18e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:55Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Creating volume 82c471c4-8397-4093-81f3-9ff5c5f18e3d {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:55 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:55 devstack sudo[89456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d 1073741824
Apr 16 02:41:55 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:55 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2.b48f2367-30a5-426c-9f07-74c2ebc9b880" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-b48f2367-30a5-426c-9f07-74c2ebc9b880" released by "_delete_snapshot" :: held 2.117s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-be12ff49-627a-45cf-a70a-b357c034cad2" released by "delete_snapshot" :: held 2.129s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Created reservations ['62bd8d5d-39bd-4f45-b167-b17d707d3020', '332662e2-451c-49fe-a4c8-f9ce6185f005', 'ebcdcd8b-dc77-4e9f-bad9-d912d69a27ea', 'eb1009d6-fd90-4ae6-b3bc-274ad664cfd3'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:55 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Delete snapshot completed successfully.
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0c97fe1-7a56-43d5-95f7-b879cdbb7d86 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-b48f2367-30a5-426c-9f07-74c2ebc9b880-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:55 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d 1073741824" returned: 0 in 0.578s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:55 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d
Apr 16 02:41:55 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Acquiring lock "cinder-quobyte-0e7a6f20-50f6-4a95-8930-349185e1994a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Lock "cinder-quobyte-0e7a6f20-50f6-4a95-8930-349185e1994a" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de251e3-0f72-4693-8eab-39ca86f5d749]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:56 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a
Apr 16 02:41:56 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:56 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d" returned: 0 in 0.464s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1ebcdf-f7f2-44a6-81de-cf36f496703d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4198a21f-3e3e-4be3-8b34-b89982df1963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:56 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Volume volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d (82c471c4-8397-4093-81f3-9ff5c5f18e3d): created successfully
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4198a21f-3e3e-4be3-8b34-b89982df1963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (23f2fd96-1465-42cb-aaed-88734864f51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:56 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-116fbc59-bdab-4309-8c5d-4cb40a59dabe tempest-VolumesGetTest-1962211217 None] Created volume successfully.
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-be12ff49-627a-45cf-a70a-b357c034cad2-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-be12ff49-627a-45cf-a70a-b357c034cad2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-be12ff49-627a-45cf-a70a-b357c034cad2" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-be12ff49-627a-45cf-a70a-b357c034cad2" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb25ca5-e2b4-4df7-9220-0b38bff6416d]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:56 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2
Apr 16 02:41:56 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:56 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a" returned: 0 in 0.553s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:56 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a
Apr 16 02:41:56 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:57 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2" returned: 0 in 0.505s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:57 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2
Apr 16 02:41:57 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:57 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0e7a6f20-50f6-4a95-8930-349185e1994a" returned: 0 in 0.457s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Lock "cinder-quobyte-0e7a6f20-50f6-4a95-8930-349185e1994a" released by "delete_volume" :: held 1.036s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Created reservations ['47b43808-cd92-451b-a04d-8fa89a933b36'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:57 devstack cinder-volume[83205]: WARNING cinder.quota [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-278643637 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-278643637, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:41:57 devstack cinder-volume[83205]: WARNING cinder.quota [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-278643637 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-278643637, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Created reservations ['dff042fc-0686-40ce-b840-3f57e06b03f9', 'e6f6fb56-16fa-4bc7-af78-3626ddf83266', '6dbe12d8-5b09-4596-adfb-54f394682897', 'ae7db51e-3bba-4a6c-a270-6193a0404ed1'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-82c471c4-8397-4093-81f3-9ff5c5f18e3d-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Lock "cinder-82c471c4-8397-4093-81f3-9ff5c5f18e3d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:57 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:57 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-82c471c4-8397-4093-81f3-9ff5c5f18e3d" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-82c471c4-8397-4093-81f3-9ff5c5f18e3d" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d64c66-cabb-4ff8-9105-04482cbcc135]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:57 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d
Apr 16 02:41:57 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:57 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-be12ff49-627a-45cf-a70a-b357c034cad2" returned: 0 in 0.496s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-be12ff49-627a-45cf-a70a-b357c034cad2" released by "delete_volume" :: held 1.032s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Created reservations ['2098341b-d881-4d4e-81e8-1b436ced88c0', 'ed6f2d1a-0943-4475-b509-d546aebdc5c3', 'd4614df7-fdd7-457e-83a5-7d9ea402ee50', '7c3337fa-c8b3-4352-80b8-26876720f60a'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:57 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:57 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:57 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:57 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:57 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-27eada80-63c5-47eb-bf84-e3e6209ffa0a tempest-GroupsTest-779903123 None] Delete group completed successfully.
Apr 16 02:41:58 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d" returned: 0 in 0.573s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:58 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d
Apr 16 02:41:58 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:58 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.467s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Deleted volume successfully.
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bd56bf84-b497-44d9-a6a6-fa8c5d844127 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-be12ff49-627a-45cf-a70a-b357c034cad2-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Created reservations ['9d3c0fd3-ec80-4610-98c8-1ad044b1df32'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:58 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:58 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:58 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-82c471c4-8397-4093-81f3-9ff5c5f18e3d" returned: 0 in 0.521s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-82c471c4-8397-4093-81f3-9ff5c5f18e3d" released by "delete_volume" :: held 1.122s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Created reservations ['9c44b9f3-b848-4db7-8f31-d227372ec24f', '7ea9bbaa-0129-4332-9cca-0c0daa272540', '2247fde2-5017-4f89-a34c-f94e5f104b66', 'c0808cbf-bd53-49df-a146-20fe622c9012'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:58 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:41:58 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:58 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.508s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d742f77a-fc04-4074-b50b-46f38ee52b27 tempest-GroupsTest-779903123 None] Delete group completed successfully.
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (a30c03ea-5d58-4105-87e5-5d96e3c40897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:41:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875e2b93-d0eb-48fb-af00-d43ea8665629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875e2b93-d0eb-48fb-af00-d43ea8665629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1557540395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0550a110-8e23-417c-9015-e6fba6c6ddb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b0e9acbcf4a868e6f403a0f9a286d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:59Z,use_quota=True,user_id='d2f6b4bee7d644bb903cd9fd41eca0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5db455-aae8-46ea-a5f7-d8869306bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5db455-aae8-46ea-a5f7-d8869306bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ab6910-8cd4-46e9-a585-7c5d6abc3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ab6910-8cd4-46e9-a585-7c5d6abc3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0550a110-8e23-417c-9015-e6fba6c6ddb2', 'volume_name': 'volume-0550a110-8e23-417c-9015-e6fba6c6ddb2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae72a913-8c63-4982-8c59-a87f94c7c7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae72a913-8c63-4982-8c59-a87f94c7c7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50e1c10-16f2-4e54-9043-f85aa7c61a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:41:59 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Volume 0550a110-8e23-417c-9015-e6fba6c6ddb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0550a110-8e23-417c-9015-e6fba6c6ddb2', 'volume_size': 1}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1557540395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0550a110-8e23-417c-9015-e6fba6c6ddb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b0e9acbcf4a868e6f403a0f9a286d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:41:59Z,use_quota=True,user_id='d2f6b4bee7d644bb903cd9fd41eca0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Creating volume 0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:41:59 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:59 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 1073741824
Apr 16 02:41:59 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:59 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.484s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:41:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Deleted volume successfully.
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4904e27e-2617-4b02-8e0c-5135a427fae7 tempest-VolumesGetTest-1962211217 None] Lock "cinder-82c471c4-8397-4093-81f3-9ff5c5f18e3d-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:41:59 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 1073741824" returned: 0 in 0.534s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:59 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2
Apr 16 02:41:59 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Lock "cinder-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56e294e-1c07-4281-a2d1-50c367dff6bd]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:59 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854
Apr 16 02:41:59 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:41:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:41:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-73dcb00e-8932-47dd-8267-123a8a3ec46a tempest-GroupsTest-779903123 None] Group tempest-GroupsTest-Group-983503052: creating
Apr 16 02:42:00 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:00 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-73dcb00e-8932-47dd-8267-123a8a3ec46a tempest-GroupsTest-779903123 None] Group tempest-GroupsTest-Group-983503052: created successfully
Apr 16 02:42:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-73dcb00e-8932-47dd-8267-123a8a3ec46a tempest-GroupsTest-779903123 None] Create group completed successfully.
Apr 16 02:42:00 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2" returned: 0 in 0.454s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50e1c10-16f2-4e54-9043-f85aa7c61a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0550a110-8e23-417c-9015-e6fba6c6ddb2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892e9505-6826-498e-8a42-fd01ab105e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:00 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Volume volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 (0550a110-8e23-417c-9015-e6fba6c6ddb2): created successfully
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892e9505-6826-498e-8a42-fd01ab105e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (a30c03ea-5d58-4105-87e5-5d96e3c40897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-11645fbb-694d-4abd-bbe2-32aea5f55f24 tempest-VolumeDependencyTests-254074194 None] Created volume successfully.
Apr 16 02:42:00 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854" returned: 0 in 0.529s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:00 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854
Apr 16 02:42:00 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:00 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.486s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:00 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854" returned: 0 in 0.426s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854" released by "delete_volume" :: held 0.979s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Created reservations ['8be41415-0774-4b58-a3d7-23e17eff462a', '66969ff8-cb03-4212-99e1-ffd54d102ff2', '84da4eac-d47a-4932-8bfc-d227fe48700b', '63c0cce1-f314-49e8-91c5-1e94311e8bb9'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:00 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:00 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:01 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.520s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:01 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Deleted volume successfully.
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=216,cinder:INSERT=71,cinder:UPDATE=325,cinder:DELETE=30 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d5d5afed-783c-48a6-84e4-1bc24b9eb12b tempest-VolumesGetTest-1962211217 None] Lock "cinder-4c1b3bb9-6c1c-4b29-8339-cc00fd6b6854-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Flow 'volume_create_manager' (77f3d185-cf4c-45ec-8df8-3f949421fbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fa536c-185b-4968-9448-d572b2330b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fa536c-185b-4968-9448-d572b2330b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1682103586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1f31071-3b97-4ef1-a204-f8dd5cbbede7,host='devstack@QuobyteHD#QuobyteHD',id=00e13d98-b46c-43a6-a9d2-3b566d864d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e7407c006d46099891bc2f71f21433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:01Z,use_quota=True,user_id='e0f7b20bf9c94f24896dc95c48dd860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73e75a7d-372c-4988-a7d2-7844df9ad98e),volume_type_id=73e75a7d-372c-4988-a7d2-7844df9ad98e)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4284bb2c-1193-42a1-98f4-6eb58e490e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4284bb2c-1193-42a1-98f4-6eb58e490e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af4a49a-2041-4947-853a-d8297787d026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af4a49a-2041-4947-853a-d8297787d026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e13d98-b46c-43a6-a9d2-3b566d864d12', 'volume_name': 'volume-00e13d98-b46c-43a6-a9d2-3b566d864d12', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161ea322-0b0c-49ea-b4ad-966891afb2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161ea322-0b0c-49ea-b4ad-966891afb2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3836ea7-602e-4ce2-8eb3-083c3db6000c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Volume 00e13d98-b46c-43a6-a9d2-3b566d864d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e13d98-b46c-43a6-a9d2-3b566d864d12', 'volume_size': 1}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d1f31071-3b97-4ef1-a204-f8dd5cbbede7,created_at=2026-04-16T00:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1682103586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1f31071-3b97-4ef1-a204-f8dd5cbbede7,host='devstack@QuobyteHD#QuobyteHD',id=00e13d98-b46c-43a6-a9d2-3b566d864d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e7407c006d46099891bc2f71f21433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:01Z,use_quota=True,user_id='e0f7b20bf9c94f24896dc95c48dd860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73e75a7d-372c-4988-a7d2-7844df9ad98e),volume_type_id=73e75a7d-372c-4988-a7d2-7844df9ad98e)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Creating volume 00e13d98-b46c-43a6-a9d2-3b566d864d12 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:01 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:01 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12 1073741824
Apr 16 02:42:01 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (941da06b-9b11-466a-bf99-697006b86310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f6b44b-b2dc-49bd-ae33-acf8e6f40d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f6b44b-b2dc-49bd-ae33-acf8e6f40d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1191054680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418741b1-bdbc-4740-b9b1-8423ae714016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b0e9acbcf4a868e6f403a0f9a286d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0550a110-8e23-417c-9015-e6fba6c6ddb2,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:01Z,use_quota=True,user_id='d2f6b4bee7d644bb903cd9fd41eca0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c726a-db6b-462f-83e1-2f065faba763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c726a-db6b-462f-83e1-2f065faba763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d7d436-1609-4975-a101-42e1fa23c630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d7d436-1609-4975-a101-42e1fa23c630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '418741b1-bdbc-4740-b9b1-8423ae714016', 'volume_name': 'volume-418741b1-bdbc-4740-b9b1-8423ae714016', 'volume_size': 1, 'source_volid': '0550a110-8e23-417c-9015-e6fba6c6ddb2', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca17a4a-3c30-40b9-b77d-7ec10059e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca17a4a-3c30-40b9-b77d-7ec10059e973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4848e4f0-e720-4587-a6a4-bc6acc185be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:01 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Volume 418741b1-bdbc-4740-b9b1-8423ae714016: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-418741b1-bdbc-4740-b9b1-8423ae714016', 'volume_size': 1, 'source_volid': '0550a110-8e23-417c-9015-e6fba6c6ddb2', 'source_volstatus': 'available'}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:01 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12 1073741824" returned: 0 in 0.516s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:INSERT=79,cinder:UPDATE=314,cinder:SELECT=245,cinder:DELETE=23 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:42:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:01 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12
Apr 16 02:42:01 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (44d08705-09c5-4bab-acee-08b2e18dab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8230b78-b63c-4724-9e3e-37948adff589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8230b78-b63c-4724-9e3e-37948adff589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1540214881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e35eda-0e4c-4093-8226-cd65e950646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:02Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0f660f-617b-405a-aa6e-2322370e364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0f660f-617b-405a-aa6e-2322370e364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e487c-887d-4734-a9b0-c0779e73c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25e487c-887d-4734-a9b0-c0779e73c88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e35eda-0e4c-4093-8226-cd65e950646b', 'volume_name': 'volume-f7e35eda-0e4c-4093-8226-cd65e950646b', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745fd054-da81-4107-a285-1ac2cc57529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745fd054-da81-4107-a285-1ac2cc57529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd64791-a6df-43b0-adb5-eef3f8ecead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:02 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Volume f7e35eda-0e4c-4093-8226-cd65e950646b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e35eda-0e4c-4093-8226-cd65e950646b', 'volume_size': 1}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:02 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12" returned: 0 in 0.440s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.863s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:02 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Cloning volume 0550a110-8e23-417c-9015-e6fba6c6ddb2 to volume 418741b1-bdbc-4740-b9b1-8423ae714016
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3836ea7-602e-4ce2-8eb3-083c3db6000c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e13d98-b46c-43a6-a9d2-3b566d864d12', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e31fa-32b8-47b6-b017-9b3d540f140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:02 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Volume volume-00e13d98-b46c-43a6-a9d2-3b566d864d12 (00e13d98-b46c-43a6-a9d2-3b566d864d12): created successfully
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e31fa-32b8-47b6-b017-9b3d540f140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Flow 'volume_create_manager' (77f3d185-cf4c-45ec-8df8-3f949421fbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:02 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-379daad4-5912-42a9-a3de-6bc603657816 tempest-GroupsTest-779903123 None] Created volume successfully.
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Creating offline snapshot 3651fb3c-af9d-4fbb-bc58-504adea284e8 of volume 0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd196bb-d444-4a90-9078-93c29f9b9872]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:02 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2
Apr 16 02:42:02 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:02 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2" returned: 0 in 0.476s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:02 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 1G
Apr 16 02:42:02 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:03 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 1G" returned: 0 in 0.472s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:03 devstack sudo[89577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8
Apr 16 02:42:03 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Flow 'volume_create_manager' (56e6a57f-bd45-4cf4-a2d7-ed523a365dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f605703-df3e-4161-a18a-27a8d1914d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f605703-df3e-4161-a18a-27a8d1914d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2010573480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1f31071-3b97-4ef1-a204-f8dd5cbbede7,host='devstack@QuobyteHD#QuobyteHD',id=1b68bead-6d69-4589-88a1-632b732735de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e7407c006d46099891bc2f71f21433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:04Z,use_quota=True,user_id='e0f7b20bf9c94f24896dc95c48dd860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73e75a7d-372c-4988-a7d2-7844df9ad98e),volume_type_id=73e75a7d-372c-4988-a7d2-7844df9ad98e)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2897df7-f67c-4092-8441-005b47657877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2897df7-f67c-4092-8441-005b47657877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8c7217-12bb-420b-a7f3-49b17a67c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da8c7217-12bb-420b-a7f3-49b17a67c680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b68bead-6d69-4589-88a1-632b732735de', 'volume_name': 'volume-1b68bead-6d69-4589-88a1-632b732735de', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265d3d1d-b785-47d5-8ce0-306084231205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265d3d1d-b785-47d5-8ce0-306084231205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8418dc-04e9-4c2d-868b-ee07eaa4f6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:03 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Volume 1b68bead-6d69-4589-88a1-632b732735de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b68bead-6d69-4589-88a1-632b732735de', 'volume_size': 1}
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:03 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8" returned: 0 in 0.472s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:03 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 is being set with open permissions: ugo+rw
Apr 16 02:42:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:03 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8
Apr 16 02:42:03 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:04 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8" returned: 0 in 0.417s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:04 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.info
Apr 16 02:42:04 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:04 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.info" returned: 0 in 0.434s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:04 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.info is being set with open permissions: ugo+rw
Apr 16 02:42:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:04 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.info
Apr 16 02:42:04 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:05 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.info" returned: 0 in 0.417s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-418741b1-bdbc-4740-b9b1-8423ae714016" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-418741b1-bdbc-4740-b9b1-8423ae714016" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] snapshot: 3651fb3c-af9d-4fbb-bc58-504adea284e8, volume: 418741b1-bdbc-4740-b9b1-8423ae714016,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[494a4e58-e10f-4604-89f5-5d1a7baec892]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:05 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8
Apr 16 02:42:05 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:05 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8" returned: 0 in 0.477s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0550a110-8e23-417c-9015-e6fba6c6ddb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[73933172-1369-4e90-81bf-2a73e17cfa96]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:05 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2
Apr 16 02:42:05 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:06 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2" returned: 0 in 0.495s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:06 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:42:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:06 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016
Apr 16 02:42:06 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:08 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016" returned: 0 in 2.140s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:08 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53d3f86-5a2a-4c05-ac83-d0da3dcd6738]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:08 devstack sudo[89614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2
Apr 16 02:42:08 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:08 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2" returned: 0 in 0.653s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:08 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2, size 1024.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:42:08 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Converted 1024.00 MB image at 478.25 MB/s
Apr 16 02:42:08 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016 is being set with open permissions: ugo+rw
Apr 16 02:42:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:08 devstack sudo[89619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016
Apr 16 02:42:08 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:09 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-418741b1-bdbc-4740-b9b1-8423ae714016" released by "_copy_volume_from_snapshot" :: held 4.284s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-3651fb3c-af9d-4fbb-bc58-504adea284e8" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-3651fb3c-af9d-4fbb-bc58-504adea284e8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Deleting offline snapshot 3651fb3c-af9d-4fbb-bc58-504adea284e8 of volume 0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] snapshot_file for this snap is: volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcba538-f060-48b3-bbeb-fb3f554e60de]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:09 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8
Apr 16 02:42:09 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:09 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0550a110-8e23-417c-9015-e6fba6c6ddb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f0d2c5-8f80-4b61-83e2-c63773419da2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:10 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2
Apr 16 02:42:10 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:10 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2" returned: 0 in 0.497s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:10 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8
Apr 16 02:42:10 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:10 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8" returned: 0 in 0.509s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:11 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8
Apr 16 02:42:11 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:11 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2.3651fb3c-af9d-4fbb-bc58-504adea284e8" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-3651fb3c-af9d-4fbb-bc58-504adea284e8" released by "_delete_snapshot" :: held 2.003s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.108s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.387s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1540214881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e35eda-0e4c-4093-8226-cd65e950646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:02Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Creating volume f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:11 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4848e4f0-e720-4587-a6a4-bc6acc185be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418741b1-bdbc-4740-b9b1-8423ae714016', 'volume_size': 1, 'source_volid': '0550a110-8e23-417c-9015-e6fba6c6ddb2', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:11 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b 1073741824
Apr 16 02:42:11 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddf67e2-7646-4e65-ba6c-5843d55549c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Volume volume-418741b1-bdbc-4740-b9b1-8423ae714016 (418741b1-bdbc-4740-b9b1-8423ae714016): created successfully
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddf67e2-7646-4e65-ba6c-5843d55549c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Flow 'volume_create_manager' (941da06b-9b11-466a-bf99-697006b86310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:11 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0afbb009-90c6-43fb-861a-0b99b9d2ff25 tempest-VolumeDependencyTests-254074194 None] Created volume successfully.
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-0550a110-8e23-417c-9015-e6fba6c6ddb2-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-0550a110-8e23-417c-9015-e6fba6c6ddb2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-0550a110-8e23-417c-9015-e6fba6c6ddb2" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-0550a110-8e23-417c-9015-e6fba6c6ddb2" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b1b547-59dc-41d2-ab23-b49efa145f58]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:12 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b 1073741824" returned: 0 in 0.600s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:12 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b
Apr 16 02:42:12 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:12 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2
Apr 16 02:42:12 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:12 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b" returned: 0 in 0.479s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.785s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d1f31071-3b97-4ef1-a204-f8dd5cbbede7,created_at=2026-04-16T00:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2010573480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1f31071-3b97-4ef1-a204-f8dd5cbbede7,host='devstack@QuobyteHD#QuobyteHD',id=1b68bead-6d69-4589-88a1-632b732735de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41e7407c006d46099891bc2f71f21433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:04Z,use_quota=True,user_id='e0f7b20bf9c94f24896dc95c48dd860b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73e75a7d-372c-4988-a7d2-7844df9ad98e),volume_type_id=73e75a7d-372c-4988-a7d2-7844df9ad98e)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Creating volume 1b68bead-6d69-4589-88a1-632b732735de {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:12 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd64791-a6df-43b0-adb5-eef3f8ecead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e35eda-0e4c-4093-8226-cd65e950646b', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:12 devstack sudo[89654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de 1073741824
Apr 16 02:42:12 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5e6efb-4536-462a-8086-792dd320ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:12 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2" returned: 0 in 0.566s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:12 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Volume volume-f7e35eda-0e4c-4093-8226-cd65e950646b (f7e35eda-0e4c-4093-8226-cd65e950646b): created successfully
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5e6efb-4536-462a-8086-792dd320ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:12 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2
Apr 16 02:42:12 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (44d08705-09c5-4bab-acee-08b2e18dab17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:12 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-cce1cb89-ddb6-43c8-bb9d-5383f877cec9 tempest-VolumesGetTest-1962211217 None] Created volume successfully.
Apr 16 02:42:13 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0550a110-8e23-417c-9015-e6fba6c6ddb2" returned: 0 in 0.472s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-0550a110-8e23-417c-9015-e6fba6c6ddb2" released by "delete_volume" :: held 1.093s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:13 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de 1073741824" returned: 0 in 0.557s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Created reservations ['62b7d9d8-27ce-43d8-a10c-0a7abf1834de', 'd1190a2e-91d6-43aa-85a8-bd88c29877cc', '2af48ec8-1ceb-4c8f-8157-036f357826f6', '4011afff-fbbb-4949-91a0-7140c79dcd55'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:13 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de
Apr 16 02:42:13 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:13 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:13 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:13 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de" returned: 0 in 0.501s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:13 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.452s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:13 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Deleted volume successfully.
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8418dc-04e9-4c2d-868b-ee07eaa4f6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b68bead-6d69-4589-88a1-632b732735de', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de05626-67e6-4564-aab1-bd513a431122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:13 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Volume volume-1b68bead-6d69-4589-88a1-632b732735de (1b68bead-6d69-4589-88a1-632b732735de): created successfully
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de05626-67e6-4564-aab1-bd513a431122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Flow 'volume_create_manager' (56e6a57f-bd45-4cf4-a2d7-ed523a365dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-88821018-8864-4c4d-9300-63790f6e9232 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-0550a110-8e23-417c-9015-e6fba6c6ddb2-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:13 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0a54fb8e-0f15-4fa1-9c9f-e84c52e41a7d tempest-GroupsTest-779903123 None] Created volume successfully.
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (e62f8ecc-4dae-4d64-b46c-5d9c1ae28d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cca380-2546-4423-b3ff-9cac4e6ee878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1cca380-2546-4423-b3ff-9cac4e6ee878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1535112237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3e04e9-611b-425a-98e5-6299d0e1a179,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f7e35eda-0e4c-4093-8226-cd65e950646b,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:14Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0559c804-3034-4ee1-b02f-48b720db6d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0559c804-3034-4ee1-b02f-48b720db6d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218cf24b-7da6-434c-9b1a-f4a0d7ce3362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218cf24b-7da6-434c-9b1a-f4a0d7ce3362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2a3e04e9-611b-425a-98e5-6299d0e1a179', 'volume_name': 'volume-2a3e04e9-611b-425a-98e5-6299d0e1a179', 'volume_size': 1, 'source_volid': 'f7e35eda-0e4c-4093-8226-cd65e950646b', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919d627f-848e-4897-8df1-dce7d07deaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919d627f-848e-4897-8df1-dce7d07deaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a809324-0fe7-44b4-bb2a-1029ab0658e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:13 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Volume 2a3e04e9-611b-425a-98e5-6299d0e1a179: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2a3e04e9-611b-425a-98e5-6299d0e1a179', 'volume_size': 1, 'source_volid': 'f7e35eda-0e4c-4093-8226-cd65e950646b', 'source_volstatus': 'available'}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:14 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Cloning volume f7e35eda-0e4c-4093-8226-cd65e950646b to volume 2a3e04e9-611b-425a-98e5-6299d0e1a179
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Creating offline snapshot 2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac of volume f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa8745d-970e-4ae2-af79-770b272f87a2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:14 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b
Apr 16 02:42:14 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-418741b1-bdbc-4740-b9b1-8423ae714016-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-418741b1-bdbc-4740-b9b1-8423ae714016-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-418741b1-bdbc-4740-b9b1-8423ae714016" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-418741b1-bdbc-4740-b9b1-8423ae714016" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a98cc4c-db0c-4491-b2d9-f0bcad034533]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:14 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016
Apr 16 02:42:14 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:14 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b" returned: 0 in 0.513s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:14 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac 1G
Apr 16 02:42:14 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:14 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016" returned: 0 in 0.518s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:14 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016
Apr 16 02:42:14 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:14 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c1205412-e006-4866-8089-2fc4a0167617 tempest-GroupsTest-779903123 None] Update group completed successfully.
Apr 16 02:42:15 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac 1G" returned: 0 in 0.568s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e35eda-0e4c-4093-8226-cd65e950646b -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:15 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e35eda-0e4c-4093-8226-cd65e950646b -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac
Apr 16 02:42:15 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:15 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-418741b1-bdbc-4740-b9b1-8423ae714016" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-418741b1-bdbc-4740-b9b1-8423ae714016" released by "delete_volume" :: held 1.046s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Created reservations ['d7f04c4a-e0fc-4e2e-bc16-fcf9dc9bf4fe', '1a8f9c4a-6a67-4998-b9aa-2433e46e620b', '516840d4-1582-41cd-a95e-07b7f5245ff9', '7a196773-798b-4b7e-91ed-508788abd402'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:15 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:15 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:15 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e35eda-0e4c-4093-8226-cd65e950646b -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" returned: 0 in 0.502s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:15 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac is being set with open permissions: ugo+rw
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:15 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac
Apr 16 02:42:15 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:15 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.429s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:15 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Deleted volume successfully.
Apr 16 02:42:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-26cd3d98-372a-4a49-8c67-a46f50f6d091 tempest-VolumeDependencyTests-254074194 None] Lock "cinder-418741b1-bdbc-4740-b9b1-8423ae714016-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-89781ce9-8c42-46ef-a77f-6618c659f655 tempest-GroupsTest-779903123 None] Update group completed successfully.
Apr 16 02:42:16 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" returned: 0 in 0.502s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:16 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.info
Apr 16 02:42:16 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-0f01e5fd-cf36-447f-bd43-1dc860995361-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Lock "cinder-0f01e5fd-cf36-447f-bd43-1dc860995361-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Acquiring lock "cinder-quobyte-0f01e5fd-cf36-447f-bd43-1dc860995361" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-0f01e5fd-cf36-447f-bd43-1dc860995361" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5898a7-7a40-462d-bcef-ab29456e8d73]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:16 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.info" returned: 0 in 0.430s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:16 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.info is being set with open permissions: ugo+rw
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:16 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.info
Apr 16 02:42:16 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:16 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361
Apr 16 02:42:16 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:16 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:17 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361
Apr 16 02:42:17 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:17 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.info" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-2a3e04e9-611b-425a-98e5-6299d0e1a179" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-2a3e04e9-611b-425a-98e5-6299d0e1a179" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] snapshot: 2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac, volume: 2a3e04e9-611b-425a-98e5-6299d0e1a179,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a0b06c-ff8b-47f1-ba48-244ec3d56310]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:17 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac
Apr 16 02:42:17 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Acquiring lock "cinder-quobyte-00e13d98-b46c-43a6-a9d2-3b566d864d12" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Lock "cinder-quobyte-00e13d98-b46c-43a6-a9d2-3b566d864d12" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f4851-8548-49b3-87ae-56cad9238b23]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:17 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12
Apr 16 02:42:17 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:17 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0f01e5fd-cf36-447f-bd43-1dc860995361" returned: 0 in 0.502s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Lock "cinder-quobyte-0f01e5fd-cf36-447f-bd43-1dc860995361" released by "delete_volume" :: held 0.986s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Created reservations ['be096b7d-7b0b-40f9-8ee4-1eabbcdb44d9', 'ea486af2-47fc-4a3c-b34e-548482548fba', 'd3e37629-169f-4290-a21f-f83808bb713e', '3f1a6aae-532a-4bb9-a3a3-2c6f5f9bdeb5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:17 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" returned: 0 in 0.570s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e35eda-0e4c-4093-8226-cd65e950646b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:42:17 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:17 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad98ce8-7a6e-4f1b-b6a1-174afe425485]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:17 devstack sudo[89721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b
Apr 16 02:42:17 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:17 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12" returned: 0 in 0.602s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:18 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12
Apr 16 02:42:18 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:18 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.414s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Deleted volume successfully.
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-7fd77eee-5070-4859-acd2-be1cf0f10fbd tempest-VolumeDependencyTests-254074194 None] Lock "cinder-0f01e5fd-cf36-447f-bd43-1dc860995361-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:18 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b" returned: 0 in 0.556s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:18 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179
Apr 16 02:42:18 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:18 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-00e13d98-b46c-43a6-a9d2-3b566d864d12" returned: 0 in 0.427s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Lock "cinder-quobyte-00e13d98-b46c-43a6-a9d2-3b566d864d12" released by "delete_volume" :: held 1.056s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Acquiring lock "cinder-quobyte-1b68bead-6d69-4589-88a1-632b732735de" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Lock "cinder-quobyte-1b68bead-6d69-4589-88a1-632b732735de" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb8dc94-e3f2-404c-8393-5592f4419431]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:18 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de
Apr 16 02:42:18 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:20 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de" returned: 0 in 1.686s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:20 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de
Apr 16 02:42:20 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:20 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179" returned: 0 in 2.403s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f190b-919e-4927-ab01-b9056f327f71]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:20 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b
Apr 16 02:42:20 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:20 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1b68bead-6d69-4589-88a1-632b732735de" returned: 0 in 0.761s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Lock "cinder-quobyte-1b68bead-6d69-4589-88a1-632b732735de" released by "delete_volume" :: held 2.476s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:20 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Created reservations ['de67a915-784b-4ba3-bcae-8a2b7c7932bb'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:21 devstack cinder-volume[83205]: WARNING cinder.quota [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2109664620 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2109664620, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:42:21 devstack cinder-volume[83205]: WARNING cinder.quota [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2109664620 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2109664620, it is now deprecated. Please use the default quota class for default quota.
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Created reservations ['7297b925-7340-4ac1-9888-23a77c5cd9fc', 'dbfaf408-8fcc-47c0-9ca3-7cf1a3244171', '6ad000a2-7e21-482c-8116-3bdecae8ec3b', 'b0279bd1-166f-44f1-a84c-01198e2d51f5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Created reservations ['1b44c94e-9f66-485d-90fb-d348020a6d98', '0aae274c-2909-4015-ad11-f94db9eb1a4e', 'f5d340a2-3298-447f-8e91-b885af7880b6', 'eb3ec508-045a-41ff-8d8d-aa12dd9cc78a'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:21 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:21 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:21 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b" returned: 0 in 0.764s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:42:21 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Converted 1024.00 MB image at 425.94 MB/s
Apr 16 02:42:21 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 is being set with open permissions: ugo+rw
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:21 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179
Apr 16 02:42:21 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:21 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.582s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-dceb4f50-b509-465c-97b9-b62d0107bc78 tempest-GroupsTest-779903123 None] Delete group completed successfully.
Apr 16 02:42:21 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179" returned: 0 in 0.491s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-2a3e04e9-611b-425a-98e5-6299d0e1a179" released by "_copy_volume_from_snapshot" :: held 4.837s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Deleting offline snapshot 2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac of volume f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] snapshot_file for this snap is: volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[45977eea-c723-4ba6-85a6-fb939d13654f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:22 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac
Apr 16 02:42:22 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Flow 'volume_create_manager' (d3585afc-4f86-44d5-b918-ff4b12fd77c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88536e73-9942-4570-8184-f281b28252de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88536e73-9942-4570-8184-f281b28252de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8f3758-1e51-4e1f-b30e-5311d2795d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6ca5ee0b8a41e3850ba1209b31850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:22Z,use_quota=True,user_id='1aa2ca15ac414d3c87c2b259b1b7896d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a764635e-4c1d-455e-a25d-fc3f68e87b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a764635e-4c1d-455e-a25d-fc3f68e87b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1becf6-d401-43f0-bc36-ec98d53c28ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1becf6-d401-43f0-bc36-ec98d53c28ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8f3758-1e51-4e1f-b30e-5311d2795d21', 'volume_name': 'volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f86f9f-fe00-4cc4-8a2d-b6b26e39d93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f86f9f-fe00-4cc4-8a2d-b6b26e39d93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20423316-2664-455e-b330-dd3933906f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:22 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Volume 1f8f3758-1e51-4e1f-b30e-5311d2795d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21', 'volume_size': 1}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:22 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" returned: 0 in 0.587s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e35eda-0e4c-4093-8226-cd65e950646b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67f8b1-cd2b-4805-8f28-b72138d5bc28]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:22 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b
Apr 16 02:42:22 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:23 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b" returned: 0 in 0.508s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:23 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac
Apr 16 02:42:23 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:23 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" returned: 0 in 0.565s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:23 devstack sudo[89781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac
Apr 16 02:42:23 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:24 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b.2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" returned: 0 in 0.474s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-2cc39a4f-e0f0-4834-8f45-1d7804bfd8ac" released by "_delete_snapshot" :: held 2.191s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.112s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8f3758-1e51-4e1f-b30e-5311d2795d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6ca5ee0b8a41e3850ba1209b31850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:22Z,use_quota=True,user_id='1aa2ca15ac414d3c87c2b259b1b7896d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Creating volume 1f8f3758-1e51-4e1f-b30e-5311d2795d21 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:24 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a809324-0fe7-44b4-bb2a-1029ab0658e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3e04e9-611b-425a-98e5-6299d0e1a179', 'volume_size': 1, 'source_volid': 'f7e35eda-0e4c-4093-8226-cd65e950646b', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bfb83d-1190-441d-8731-fd70271e1545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:24 devstack sudo[89784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21 1073741824
Apr 16 02:42:24 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:24 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Volume volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 (2a3e04e9-611b-425a-98e5-6299d0e1a179): created successfully
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bfb83d-1190-441d-8731-fd70271e1545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (e62f8ecc-4dae-4d64-b46c-5d9c1ae28d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-60290798-8d00-4aeb-b54d-ae89d0ae7b21 tempest-VolumesGetTest-1962211217 None] Created volume successfully.
Apr 16 02:42:24 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21 1073741824" returned: 0 in 0.598s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:24 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21
Apr 16 02:42:24 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:25 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21" returned: 0 in 0.575s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20423316-2664-455e-b330-dd3933906f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec8028d-012f-4ad0-9704-f9725a526709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:25 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Volume volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21 (1f8f3758-1e51-4e1f-b30e-5311d2795d21): created successfully
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec8028d-012f-4ad0-9704-f9725a526709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Flow 'volume_create_manager' (d3585afc-4f86-44d5-b918-ff4b12fd77c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-84688774-7dcb-4c8d-9788-6508c67d14bf tempest-CinderUnicodeTest-1308882536 None] Created volume successfully.
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (5a4ec32f-e50e-4207-892f-c15fbccdc824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c71d8c7-d7bb-4cb9-95d5-a2eab0f707af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c71d8c7-d7bb-4cb9-95d5-a2eab0f707af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1186464930',display_name='tempest-VolumesGetTest-Volume-263236675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f38593a-3144-4f0b-b42e-b3fcfd797f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:25Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06ffa56-f637-4e9f-804b-231df8b7eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06ffa56-f637-4e9f-804b-231df8b7eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1ead0a-9419-4a41-810d-61e8349270a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1ead0a-9419-4a41-810d-61e8349270a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f38593a-3144-4f0b-b42e-b3fcfd797f3a', 'volume_name': 'volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb441f12-d5d2-4f7f-8f44-f1a3a31ece0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb441f12-d5d2-4f7f-8f44-f1a3a31ece0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f570a745-8795-4fc1-98ad-dc1e93c4e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:25 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Volume 8f38593a-3144-4f0b-b42e-b3fcfd797f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a', 'volume_size': 1}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1186464930',display_name='tempest-VolumesGetTest-Volume-263236675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f38593a-3144-4f0b-b42e-b3fcfd797f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:25Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Creating volume 8f38593a-3144-4f0b-b42e-b3fcfd797f3a {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:25 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:25 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a 1073741824
Apr 16 02:42:25 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:26 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a 1073741824" returned: 0 in 0.593s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:26 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a
Apr 16 02:42:26 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:26 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a" returned: 0 in 0.496s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f570a745-8795-4fc1-98ad-dc1e93c4e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af776420-e218-49a3-82e8-01f8b06f3310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:26 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Volume volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a (8f38593a-3144-4f0b-b42e-b3fcfd797f3a): created successfully
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af776420-e218-49a3-82e8-01f8b06f3310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (5a4ec32f-e50e-4207-892f-c15fbccdc824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:26 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-de62cbf8-7864-4881-a88a-3c57611ae0ec tempest-VolumesGetTest-1962211217 None] Created volume successfully.
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Flow 'volume_create_manager' (5fe1022e-6531-493c-a767-2f1d69b73eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caa8e8e-5392-45e5-9ad6-2bb25aa55e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7caa8e8e-5392-45e5-9ad6-2bb25aa55e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1841085308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0f80d5-a694-40b0-b039-d40daa39d593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6ca5ee0b8a41e3850ba1209b31850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:27Z,use_quota=True,user_id='1aa2ca15ac414d3c87c2b259b1b7896d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c36320-d45b-48f9-a8a3-e08a946c7fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c36320-d45b-48f9-a8a3-e08a946c7fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474455af-5d06-4b90-9ae6-192e807b3c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (474455af-5d06-4b90-9ae6-192e807b3c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0f80d5-a694-40b0-b039-d40daa39d593', 'volume_name': 'volume-8a0f80d5-a694-40b0-b039-d40daa39d593', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5af1fec-8185-459d-afaa-40902a6bc845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5af1fec-8185-459d-afaa-40902a6bc845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6eedc85-2721-4f09-8856-38a79260c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:26 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Volume 8a0f80d5-a694-40b0-b039-d40daa39d593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0f80d5-a694-40b0-b039-d40daa39d593', 'volume_size': 1}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1841085308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0f80d5-a694-40b0-b039-d40daa39d593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6ca5ee0b8a41e3850ba1209b31850d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:27Z,use_quota=True,user_id='1aa2ca15ac414d3c87c2b259b1b7896d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Creating volume 8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:26 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:26 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 1073741824
Apr 16 02:42:26 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:27 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 1073741824" returned: 0 in 0.554s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:27 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593
Apr 16 02:42:27 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-8f38593a-3144-4f0b-b42e-b3fcfd797f3a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Lock "cinder-8f38593a-3144-4f0b-b42e-b3fcfd797f3a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-8f38593a-3144-4f0b-b42e-b3fcfd797f3a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-8f38593a-3144-4f0b-b42e-b3fcfd797f3a" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c91f1-527f-476b-86d7-937bf1446125]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:27 devstack sudo[89808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a
Apr 16 02:42:27 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:27 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593" returned: 0 in 0.523s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6eedc85-2721-4f09-8856-38a79260c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0f80d5-a694-40b0-b039-d40daa39d593', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc55196-0748-45da-83a7-e952aa39b0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:27 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Volume volume-8a0f80d5-a694-40b0-b039-d40daa39d593 (8a0f80d5-a694-40b0-b039-d40daa39d593): created successfully
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc55196-0748-45da-83a7-e952aa39b0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:27 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Flow 'volume_create_manager' (5fe1022e-6531-493c-a767-2f1d69b73eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8f12c537-1e31-4fea-9e01-92068099c813 tempest-CinderUnicodeTest-1308882536 None] Created volume successfully.
Apr 16 02:42:28 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a" returned: 0 in 0.533s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:28 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a
Apr 16 02:42:28 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:28 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8f38593a-3144-4f0b-b42e-b3fcfd797f3a" returned: 0 in 0.418s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-8f38593a-3144-4f0b-b42e-b3fcfd797f3a" released by "delete_volume" :: held 0.973s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Created reservations ['11e3f300-57e1-4a4a-b44f-6270546a1078', '2a190f63-7c9a-4087-8892-09e13ed99c2f', 'c1489f24-3218-472c-9e2c-dc1908fd9e03', '30775c05-8459-460d-910c-e09ce59840e6'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:28 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:28 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-2a3e04e9-611b-425a-98e5-6299d0e1a179-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Lock "cinder-2a3e04e9-611b-425a-98e5-6299d0e1a179-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-2a3e04e9-611b-425a-98e5-6299d0e1a179" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-2a3e04e9-611b-425a-98e5-6299d0e1a179" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2d607-6637-4a43-b911-642eb9679d2e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:29 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179
Apr 16 02:42:29 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Creating offline snapshot b92f91b5-9e7d-446c-8f51-0aaaff6e222d of volume 8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd663d76-0055-45c0-bb59-7ad69fb0d674]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:29 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:29 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593
Apr 16 02:42:29 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.511s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:29 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Deleted volume successfully.
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bbfe83c2-f36e-4ab8-b8ac-3221ea8d285d tempest-VolumesGetTest-1962211217 None] Lock "cinder-8f38593a-3144-4f0b-b42e-b3fcfd797f3a-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:29 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179" returned: 0 in 0.594s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:29 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179
Apr 16 02:42:29 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:29 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593" returned: 0 in 0.540s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:29 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d 1G
Apr 16 02:42:29 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:30 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a3e04e9-611b-425a-98e5-6299d0e1a179" returned: 0 in 0.487s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-2a3e04e9-611b-425a-98e5-6299d0e1a179" released by "delete_volume" :: held 1.120s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Flow 'volume_create_manager' (850130f2-4635-43dd-96d1-86cbd1d1f455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd089cca-bb24-4f31-b460-be196addd958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Created reservations ['adfbac9a-64ec-4dbf-97a1-fb9988ed3828', '41a58a6c-2598-4dae-b3c5-3f24ec746516', '6fa01b38-32a4-4335-8a88-091be645f5ab', '674eceda-2591-4df8-bbb5-e66ba805fa1f'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd089cca-bb24-4f31-b460-be196addd958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-15780533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3acb36d-45ca-4aff-9844-d4bf7bd574bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb16cf26d764937878530cd958e988c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:30Z,use_quota=True,user_id='8d1e1e08d7664cf19478f11edd9f6963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db22d651-6a75-4fae-94a7-9bbbff302869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db22d651-6a75-4fae-94a7-9bbbff302869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef1b709-d3f3-4429-9d1c-a3d1cdb4b65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef1b709-d3f3-4429-9d1c-a3d1cdb4b65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3acb36d-45ca-4aff-9844-d4bf7bd574bd', 'volume_name': 'volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4037c26-04ad-445b-99c8-912b59dd3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:30 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4037c26-04ad-445b-99c8-912b59dd3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38f80f-cd9a-4a2a-9ea5-8c284f169a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:30 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Volume a3acb36d-45ca-4aff-9844-d4bf7bd574bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd', 'volume_size': 1}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d 1G" returned: 0 in 0.574s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0f80d5-a694-40b0-b039-d40daa39d593 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:30 devstack sudo[89838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:30 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:30 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0f80d5-a694-40b0-b039-d40daa39d593 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d
Apr 16 02:42:30 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:30 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.410s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:30 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Deleted volume successfully.
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a32f0087-0c70-44a2-808e-5e5ea988a54f tempest-VolumesGetTest-1962211217 None] Lock "cinder-2a3e04e9-611b-425a-98e5-6299d0e1a179-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:30 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a0f80d5-a694-40b0-b039-d40daa39d593 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d" returned: 0 in 0.470s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:30 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d is being set with open permissions: ugo+rw
Apr 16 02:42:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:30 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d
Apr 16 02:42:30 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:31 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-f7e35eda-0e4c-4093-8226-cd65e950646b-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d" returned: 0 in 0.444s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Lock "cinder-f7e35eda-0e4c-4093-8226-cd65e950646b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-f7e35eda-0e4c-4093-8226-cd65e950646b" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:31 devstack sudo[89849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.info
Apr 16 02:42:31 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-f7e35eda-0e4c-4093-8226-cd65e950646b" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb7df3-d99f-4952-8026-053421050ccc]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:31 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b
Apr 16 02:42:31 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:31 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.info" returned: 0 in 0.440s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:31 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.info is being set with open permissions: ugo+rw
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:31 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.info
Apr 16 02:42:31 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:31 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:31 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b
Apr 16 02:42:31 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:32 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.info" returned: 0 in 0.418s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.839s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-15780533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3acb36d-45ca-4aff-9844-d4bf7bd574bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb16cf26d764937878530cd958e988c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:30Z,use_quota=True,user_id='8d1e1e08d7664cf19478f11edd9f6963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Creating volume a3acb36d-45ca-4aff-9844-d4bf7bd574bd {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:32 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:32 devstack sudo[89862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd 1073741824
Apr 16 02:42:32 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:32 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f4e606f3-0d11-41eb-a10b-b8f170508eaf tempest-CinderUnicodeTest-1308882536 None] Create snapshot completed successfully
Apr 16 02:42:32 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f7e35eda-0e4c-4093-8226-cd65e950646b" returned: 0 in 0.446s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-f7e35eda-0e4c-4093-8226-cd65e950646b" released by "delete_volume" :: held 0.994s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Created reservations ['a34df84b-577f-4fda-9ffa-0d7b5ec3eaa1', '6ad284da-52ec-49d6-a4f0-f11673ffdc24', '1dcd3b1c-ec46-4701-a561-ddd3b5f76b03', 'c8d25bee-e526-448a-9f15-f3fc38bc64e1'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "cinder-b92f91b5-9e7d-446c-8f51-0aaaff6e222d-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-b92f91b5-9e7d-446c-8f51-0aaaff6e222d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "cinder-quobyte-8a0f80d5-a694-40b0-b039-d40daa39d593" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-8a0f80d5-a694-40b0-b039-d40daa39d593" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "cinder-quobyte-b92f91b5-9e7d-446c-8f51-0aaaff6e222d" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-b92f91b5-9e7d-446c-8f51-0aaaff6e222d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Deleting offline snapshot b92f91b5-9e7d-446c-8f51-0aaaff6e222d of volume 8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:42:32 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:32 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] snapshot_file for this snap is: volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec249020-051d-404c-8a66-1d3e586119a2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:32 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d
Apr 16 02:42:32 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:32 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd 1073741824" returned: 0 in 0.522s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:32 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd
Apr 16 02:42:32 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:32 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.441s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:32 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Deleted volume successfully.
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f4c41736-b87e-4f00-b50d-eae8929136f5 tempest-VolumesGetTest-1962211217 None] Lock "cinder-f7e35eda-0e4c-4093-8226-cd65e950646b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:32 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d" returned: 0 in 0.500s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a0f80d5-a694-40b0-b039-d40daa39d593(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a8625-c285-4ca1-84cb-ba5024ee3f19]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:32 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593
Apr 16 02:42:32 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:33 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd" returned: 0 in 0.426s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38f80f-cd9a-4a2a-9ea5-8c284f169a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7583e-4aa5-4ea0-8da3-8d8e9c2b46a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:33 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Volume volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd (a3acb36d-45ca-4aff-9844-d4bf7bd574bd): created successfully
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7583e-4aa5-4ea0-8da3-8d8e9c2b46a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Flow 'volume_create_manager' (850130f2-4635-43dd-96d1-86cbd1d1f455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:33 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-27f863f6-7fba-4dce-be5f-fdb11c657996 tempest-VolumeQuotasAdminTestJSON-97768652 None] Created volume successfully.
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Acquiring lock "cinder-a3acb36d-45ca-4aff-9844-d4bf7bd574bd-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "cinder-a3acb36d-45ca-4aff-9844-d4bf7bd574bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:33 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Acquiring lock "cinder-quobyte-a3acb36d-45ca-4aff-9844-d4bf7bd574bd" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593" returned: 0 in 0.573s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "cinder-quobyte-a3acb36d-45ca-4aff-9844-d4bf7bd574bd" acquired by "delete_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6f36be-d769-4d41-a2e9-8a98367cb504]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:33 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d
Apr 16 02:42:33 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:33 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd
Apr 16 02:42:33 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (84c3b4b0-48f7-4a08-8655-46a7a4b48598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afbbf7-1df3-4a66-9848-4b1b8a27cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afbbf7-1df3-4a66-9848-4b1b8a27cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1846642090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260faa13-b8de-4148-8b2d-0c1dbd6d7564,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:34Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a80d7f-d29a-44c0-90ef-30a41a5ffe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a80d7f-d29a-44c0-90ef-30a41a5ffe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e9f3be-23ae-4476-ac3a-52261196eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:33 devstack cinder-volume[83205]: DEBUG cinder.image.glance [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Creating Keystone auth plugin from conf {{(pid=83205) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 02:42:34 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d" returned: 0 in 0.601s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:34 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d
Apr 16 02:42:34 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:34 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd" returned: 0 in 0.614s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:34 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd
Apr 16 02:42:34 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e9f3be-23ae-4476-ac3a-52261196eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '260faa13-b8de-4148-8b2d-0c1dbd6d7564', 'volume_name': 'volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d006bebc0>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a810d323-3017-4859-9b93-82d857162433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a810d323-3017-4859-9b93-82d857162433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61512de7-f548-405b-87a9-6f353db419bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:34 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Volume 260faa13-b8de-4148-8b2d-0c1dbd6d7564: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d006bebc0>}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Trying to clone 260faa13-b8de-4148-8b2d-0c1dbd6d7564 from image e278c10c-b2af-4a05-aacb-8b1a6716d838 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]). {{(pid=83205) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 02:42:34 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f90f855-0169-4b15-8aa7-42671ec18f36]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:34 devstack sudo[89899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD
Apr 16 02:42:34 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:34 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593.b92f91b5-9e7d-446c-8f51-0aaaff6e222d" returned: 0 in 0.441s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-b92f91b5-9e7d-446c-8f51-0aaaff6e222d" released by "_delete_snapshot" :: held 2.171s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-8a0f80d5-a694-40b0-b039-d40daa39d593" released by "delete_snapshot" :: held 2.200s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Created reservations ['29593e8a-4d44-40d8-b5e6-c05b5407b734', 'd9821525-9f44-4504-af53-0d9fe7d33c1b', '141018b2-1608-479e-a9ce-2bd7b8d43251', '5425a47f-085a-459a-9a82-24b83c5e6d3c'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:34 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a3acb36d-45ca-4aff-9844-d4bf7bd574bd" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "cinder-quobyte-a3acb36d-45ca-4aff-9844-d4bf7bd574bd" released by "delete_volume" :: held 1.130s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:34 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Delete snapshot completed successfully.
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-b3970e2d-868c-4a3a-b472-433e1bd5fdc7 tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-b92f91b5-9e7d-446c-8f51-0aaaff6e222d-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Created reservations ['e003b744-60e1-495d-8c73-7a3f1abbf151', 'ee1d05c5-6e10-4743-91d1-bdfd443a8b8d', '025bcb58-5dee-45da-848d-73a4532923c4', '3a34ce71-5b23-4834-af79-89457eb708da'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:34 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:34 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:34 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 is fetched for user 68bacbcb23fd44189010af1daa7687f8. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[534bc6a4-bbf4-4c7e-929b-54f1c54948be]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:34 devstack sudo[89911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD
Apr 16 02:42:34 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:35 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.396s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Deleted volume successfully.
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4452809f-4b58-47a3-99d8-08a136f3456e tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "cinder-a3acb36d-45ca-4aff-9844-d4bf7bd574bd-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:35 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1846642090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260faa13-b8de-4148-8b2d-0c1dbd6d7564,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:34Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Creating volume 260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:35 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:35 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 1073741824
Apr 16 02:42:35 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "cinder-8a0f80d5-a694-40b0-b039-d40daa39d593-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-8a0f80d5-a694-40b0-b039-d40daa39d593-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "cinder-quobyte-8a0f80d5-a694-40b0-b039-d40daa39d593" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-8a0f80d5-a694-40b0-b039-d40daa39d593" acquired by "delete_volume" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a4a40b-7392-4054-9b2e-e38504c7c900]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:35 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593
Apr 16 02:42:35 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Flow 'volume_create_manager' (a69e06d3-be2a-4839-aa71-e9e0aa3db583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e18541-1da6-4be6-bd17-3ac74355b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e18541-1da6-4be6-bd17-3ac74355b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1598200542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb51ceb-925a-45fc-88c9-90de330df8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb16cf26d764937878530cd958e988c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:36Z,use_quota=True,user_id='8d1e1e08d7664cf19478f11edd9f6963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5a899f-4313-40a3-a900-f68019981b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5a899f-4313-40a3-a900-f68019981b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48b7efb-56fd-42f8-a701-5b2899675fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f48b7efb-56fd-42f8-a701-5b2899675fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb51ceb-925a-45fc-88c9-90de330df8f2', 'volume_name': 'volume-0fb51ceb-925a-45fc-88c9-90de330df8f2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e90792-31b2-44c9-8249-6e78bbe7b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e90792-31b2-44c9-8249-6e78bbe7b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d7cd7b-1c3c-4562-935c-ae10c09898b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:35 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Volume 0fb51ceb-925a-45fc-88c9-90de330df8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb51ceb-925a-45fc-88c9-90de330df8f2', 'volume_size': 1}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:35 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 1073741824" returned: 0 in 0.574s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:36 devstack sudo[89925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564
Apr 16 02:42:36 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:36 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593" returned: 0 in 0.540s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:36 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593
Apr 16 02:42:36 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:36 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564" returned: 0 in 0.417s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1598200542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb51ceb-925a-45fc-88c9-90de330df8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb16cf26d764937878530cd958e988c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:36Z,use_quota=True,user_id='8d1e1e08d7664cf19478f11edd9f6963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Creating volume 0fb51ceb-925a-45fc-88c9-90de330df8f2 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:36 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:36 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2 1073741824
Apr 16 02:42:36 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Attempting download of e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume 260faa13-b8de-4148-8b2d-0c1dbd6d7564. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8124d45a-a4a8-469a-ba5d-1b11a8647575]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_mlkkci9i {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:36 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8a0f80d5-a694-40b0-b039-d40daa39d593" returned: 0 in 0.433s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-8a0f80d5-a694-40b0-b039-d40daa39d593" released by "delete_volume" :: held 1.011s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:36 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_mlkkci9i
Apr 16 02:42:36 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Created reservations ['26980fc5-2905-45e8-9e94-9e31e853e0a1', '3ad19926-0042-4080-987b-4aed50ff836c', '2968ff87-59cb-4bb3-a021-8790a4816271', '0128ef5d-bdf8-47f1-9e13-8ece04aa567f'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:36 devstack sudo[89937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:36 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:36 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2 1073741824" returned: 0 in 0.523s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:36 devstack sudo[89944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2
Apr 16 02:42:36 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:37 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_mlkkci9i" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_mlkkci9i {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:37 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.452s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Deleted volume successfully.
Apr 16 02:42:37 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_mlkkci9i
Apr 16 02:42:37 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d92e45c-622c-4149-93e1-2c6f11df7d0f tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-8a0f80d5-a694-40b0-b039-d40daa39d593-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:37 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2" returned: 0 in 0.416s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d7cd7b-1c3c-4562-935c-ae10c09898b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb51ceb-925a-45fc-88c9-90de330df8f2', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e907cf09-39f3-4157-854e-4b65ac12d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:37 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Volume volume-0fb51ceb-925a-45fc-88c9-90de330df8f2 (0fb51ceb-925a-45fc-88c9-90de330df8f2): created successfully
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e907cf09-39f3-4157-854e-4b65ac12d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Flow 'volume_create_manager' (a69e06d3-be2a-4839-aa71-e9e0aa3db583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-fcd82add-561d-492b-bddb-3c60c9c84232 tempest-VolumeQuotasAdminTestJSON-97768652 None] Created volume successfully.
Apr 16 02:42:37 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_mlkkci9i" returned: 1 in 0.467s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_mlkkci9i' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[094a6545-632c-4b3c-abc3-492bd0dcf053]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:37 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD
Apr 16 02:42:37 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "cinder-1f8f3758-1e51-4e1f-b30e-5311d2795d21-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-1f8f3758-1e51-4e1f-b30e-5311d2795d21-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "cinder-quobyte-1f8f3758-1e51-4e1f-b30e-5311d2795d21" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-1f8f3758-1e51-4e1f-b30e-5311d2795d21" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[65279910-8c49-43bd-837f-ebdfd4deeb2d]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:37 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21
Apr 16 02:42:37 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:38 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] e278c10c-b2af-4a05-aacb-8b1a6716d838 was qcow2, converting to raw {{(pid=83205) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:38 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564
Apr 16 02:42:38 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:38 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21" returned: 0 in 0.553s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:38 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21
Apr 16 02:42:38 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-24a99e63-baae-4a61-92aa-663df88d7c06 tempest-VolumeQuotasAdminTestJSON-1211111199 None] Transfer volume completed successfully.
Apr 16 02:42:38 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1f8f3758-1e51-4e1f-b30e-5311d2795d21" returned: 0 in 0.514s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-quobyte-1f8f3758-1e51-4e1f-b30e-5311d2795d21" released by "delete_volume" :: held 1.092s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Created reservations ['1a51f79d-fc3d-4886-8733-782b58802bb6', '736895ce-6027-4417-b42d-72e2239ea14c', '1baca954-ef7f-4f62-a8db-8291edffd167', '47a09d5c-da23-489e-9421-271f6ba1968d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:38 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:38 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:38 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564" returned: 0 in 0.973s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_w7ey0xgxdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:42:38 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Converted 112.00 MB image at 112.00 MB/s
Apr 16 02:42:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:39 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 1G
Apr 16 02:42:39 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Acquiring lock "cinder-0fb51ceb-925a-45fc-88c9-90de330df8f2-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Lock "cinder-0fb51ceb-925a-45fc-88c9-90de330df8f2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Acquiring lock "cinder-quobyte-0fb51ceb-925a-45fc-88c9-90de330df8f2" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Lock "cinder-quobyte-0fb51ceb-925a-45fc-88c9-90de330df8f2" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27243ad-27df-46f8-8d16-57d735da4784]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:39 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2
Apr 16 02:42:39 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:39 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.549s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Deleted volume successfully.
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f82b3fb2-92a0-438f-8f4c-736155b852ce tempest-CinderUnicodeTest-1308882536 None] Lock "cinder-1f8f3758-1e51-4e1f-b30e-5311d2795d21-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:39 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 1G" returned: 0 in 0.510s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad58ecb-a720-4491-9963-ea9e940605bd]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:39 devstack sudo[89993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564
Apr 16 02:42:39 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:39 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2" returned: 0 in 0.533s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:39 devstack sudo[89998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2
Apr 16 02:42:39 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:40 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564" returned: 0 in 0.521s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:40 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564
Apr 16 02:42:40 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:40 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fb51ceb-925a-45fc-88c9-90de330df8f2" returned: 0 in 0.541s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Lock "cinder-quobyte-0fb51ceb-925a-45fc-88c9-90de330df8f2" released by "delete_volume" :: held 1.104s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Created reservations ['780d1c62-f5db-4455-a77e-616b62b1e230', 'b7bacc16-1571-4691-b643-781c795d1245', 'd585a248-63cc-408c-aed6-cfcb1e7cd774', '6854b3ee-4edf-4c16-8ce6-dba9050fecbb'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:40 devstack sudo[90005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:40 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:40 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564" returned: 1 in 0.557s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Downloaded image e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume 260faa13-b8de-4148-8b2d-0c1dbd6d7564 successfully. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 for user 68bacbcb23fd44189010af1daa7687f8 is deleted. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Marking volume 260faa13-b8de-4148-8b2d-0c1dbd6d7564 as bootable. {{(pid=83205) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Copying metadata from image e278c10c-b2af-4a05-aacb-8b1a6716d838 to 260faa13-b8de-4148-8b2d-0c1dbd6d7564. {{(pid=83205) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Creating volume glance metadata for volume 260faa13-b8de-4148-8b2d-0c1dbd6d7564 backed by image e278c10c-b2af-4a05-aacb-8b1a6716d838 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83205) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61512de7-f548-405b-87a9-6f353db419bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d006bebc0>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63751e68-6979-49e9-b7ce-f84f24d36fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Volume volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 (260faa13-b8de-4148-8b2d-0c1dbd6d7564): created successfully
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63751e68-6979-49e9-b7ce-f84f24d36fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (84c3b4b0-48f7-4a08-8655-46a7a4b48598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:40 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4cacd3c0-c767-470b-a5c7-8f89b70fc1df tempest-VolumesGetTest-1962211217 None] Created volume successfully.
Apr 16 02:42:40 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.523s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:40 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:40 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Deleted volume successfully.
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a80651bb-860a-4cdf-b0d2-889c77ce9a0d tempest-VolumeQuotasAdminTestJSON-233203827 None] Lock "cinder-0fb51ceb-925a-45fc-88c9-90de330df8f2-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (83dfc660-e5b4-42cb-9deb-a1ec1bc55ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9103f1-3693-4ac7-9d2c-a3d63610c48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9103f1-3693-4ac7-9d2c-a3d63610c48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539617410',display_name='tempest-VolumesGetTest-Volume-1704955183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a0a75e-7461-4c63-abeb-5fd0f5194b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:42Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa580c0-6529-4fad-98d0-bd5a424e3003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa580c0-6529-4fad-98d0-bd5a424e3003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399c0f68-0a90-4c2c-be38-f2c2f49fcb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399c0f68-0a90-4c2c-be38-f2c2f49fcb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a0a75e-7461-4c63-abeb-5fd0f5194b3e', 'volume_name': 'volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d49d817-4cbe-446c-b6ed-f6ac4dff4306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d49d817-4cbe-446c-b6ed-f6ac4dff4306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78aa10e-045e-4676-a745-b5cb760c87a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:41 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Volume 54a0a75e-7461-4c63-abeb-5fd0f5194b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e', 'volume_size': 1}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539617410',display_name='tempest-VolumesGetTest-Volume-1704955183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a0a75e-7461-4c63-abeb-5fd0f5194b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f37172d723bd4b34851fe2cc111ed097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:42Z,use_quota=True,user_id='68bacbcb23fd44189010af1daa7687f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Creating volume 54a0a75e-7461-4c63-abeb-5fd0f5194b3e {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:41 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:41 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e 1073741824
Apr 16 02:42:41 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:42 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e 1073741824" returned: 0 in 0.534s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:42 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e
Apr 16 02:42:42 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:42 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e" returned: 0 in 0.460s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78aa10e-045e-4676-a745-b5cb760c87a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cca73a-a399-4e2e-825e-01d5631ed92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:42 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Volume volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e (54a0a75e-7461-4c63-abeb-5fd0f5194b3e): created successfully
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cca73a-a399-4e2e-825e-01d5631ed92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Flow 'volume_create_manager' (83dfc660-e5b4-42cb-9deb-a1ec1bc55ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:42 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-81901284-0ddd-4f4c-bb2c-911f0aae7d73 tempest-VolumesGetTest-1962211217 None] Created volume successfully.
Apr 16 02:42:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-54a0a75e-7461-4c63-abeb-5fd0f5194b3e-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Lock "cinder-54a0a75e-7461-4c63-abeb-5fd0f5194b3e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-54a0a75e-7461-4c63-abeb-5fd0f5194b3e" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-54a0a75e-7461-4c63-abeb-5fd0f5194b3e" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:44 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf9fad-4e86-4a0b-8d55-8503f291fdd3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:44 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e
Apr 16 02:42:44 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:44 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e" returned: 0 in 0.539s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:44 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e
Apr 16 02:42:44 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:45 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-54a0a75e-7461-4c63-abeb-5fd0f5194b3e" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-54a0a75e-7461-4c63-abeb-5fd0f5194b3e" released by "delete_volume" :: held 1.037s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Created reservations ['bd2c0b04-9a2a-46bd-98aa-185161bd3c44', '92a969d6-cf57-4bd2-98ea-dbc44af894bb', '0cfb1cc8-387a-45e9-9e45-dd1a854f27c2', '803168cb-b2a5-439a-aa1b-dcff5f7de587'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:45 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:45 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:45 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:45 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Deleted volume successfully.
Apr 16 02:42:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-714d6381-5691-466c-bb48-29a2a1a15715 tempest-VolumesGetTest-1962211217 None] Lock "cinder-54a0a75e-7461-4c63-abeb-5fd0f5194b3e-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-260faa13-b8de-4148-8b2d-0c1dbd6d7564-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Lock "cinder-260faa13-b8de-4148-8b2d-0c1dbd6d7564-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Acquiring lock "cinder-quobyte-260faa13-b8de-4148-8b2d-0c1dbd6d7564" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-260faa13-b8de-4148-8b2d-0c1dbd6d7564" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a864bcd5-b7aa-4dc9-b47b-081502bb9082]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:46 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564
Apr 16 02:42:46 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:46 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564" returned: 0 in 0.579s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:46 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564
Apr 16 02:42:46 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:47 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564" returned: 1 in 0.570s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:42:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:47 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564
Apr 16 02:42:47 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:48 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-260faa13-b8de-4148-8b2d-0c1dbd6d7564" returned: 0 in 0.536s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Lock "cinder-quobyte-260faa13-b8de-4148-8b2d-0c1dbd6d7564" released by "delete_volume" :: held 1.728s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Created reservations ['0f5dad34-5482-45a2-b1cf-0de9c76e0380', '380037e5-ccde-498f-b294-337ba7e9fcf2', 'eaef397c-3fff-455b-8dda-5a76b8f6aef5', '5c16cc00-54e3-469e-a53b-d81e5b5f706a'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:48 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:48 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:48 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.526s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:42:48 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Deleted volume successfully.
Apr 16 02:42:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a1c4a722-78ba-4376-a7c7-8561d2d609a3 tempest-VolumesGetTest-1962211217 None] Lock "cinder-260faa13-b8de-4148-8b2d-0c1dbd6d7564-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Flow 'volume_create_manager' (b94e138a-88f3-42ef-8772-12fc1d960314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1748c48-231e-401d-a970-083fde4b5de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1748c48-231e-401d-a970-083fde4b5de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-643261253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0659d12-af5d-46fb-b214-d3a2f2d86239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1488a19099874da98ab0a9930154a74f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:52Z,use_quota=True,user_id='a8e7e5f12d524daabef9a5d823030bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046236ec-a9b6-4e00-b98d-b4803a4e248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (046236ec-a9b6-4e00-b98d-b4803a4e248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540f08c6-0bc0-4dd3-8a27-6842a707ae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.image.glance [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Creating Keystone auth plugin from conf {{(pid=83205) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540f08c6-0bc0-4dd3-8a27-6842a707ae4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0659d12-af5d-46fb-b214-d3a2f2d86239', 'volume_name': 'volume-f0659d12-af5d-46fb-b214-d3a2f2d86239', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d008b3df0>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc9197f-b415-49f6-8641-d7ce7bb63264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc9197f-b415-49f6-8641-d7ce7bb63264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01ce792-b7eb-44af-806f-e26ff7180e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:51 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Volume f0659d12-af5d-46fb-b214-d3a2f2d86239: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0659d12-af5d-46fb-b214-d3a2f2d86239', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d008b3df0>}
Apr 16 02:42:51 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Trying to clone f0659d12-af5d-46fb-b214-d3a2f2d86239 from image e278c10c-b2af-4a05-aacb-8b1a6716d838 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]). {{(pid=83205) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 02:42:52 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 02:42:52 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 02:42:52 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285e809-3ca6-4ed9-9962-2a9db8e47aa8]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:52 devstack sudo[90053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD
Apr 16 02:42:52 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:52 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:52 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 is fetched for user a8e7e5f12d524daabef9a5d823030bf3. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 02:42:52 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6175a5-e84c-4017-a757-7f023789f2f3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:52 devstack sudo[90058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD
Apr 16 02:42:52 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:52 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-643261253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0659d12-af5d-46fb-b214-d3a2f2d86239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1488a19099874da98ab0a9930154a74f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:42:52Z,use_quota=True,user_id='a8e7e5f12d524daabef9a5d823030bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Creating volume f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:42:53 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:53 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 1073741824
Apr 16 02:42:53 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:53 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 1073741824" returned: 0 in 0.464s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:53 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239
Apr 16 02:42:53 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:53 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239" returned: 0 in 0.418s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Attempting download of e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume f0659d12-af5d-46fb-b214-d3a2f2d86239. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ec8e4c-c497-4b1c-9375-18fc67ac7479]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_o9vasy_8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:54 devstack sudo[90071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_o9vasy_8
Apr 16 02:42:54 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:54 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_o9vasy_8" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_o9vasy_8 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:54 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_o9vasy_8
Apr 16 02:42:54 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:54 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_o9vasy_8" returned: 1 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_o9vasy_8' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:42:54 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[963ae527-f738-4cc4-b628-4f3ce90653e1]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:54 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD
Apr 16 02:42:54 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:55 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD" returned: 0 in 0.475s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:55 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] e278c10c-b2af-4a05-aacb-8b1a6716d838 was qcow2, converting to raw {{(pid=83205) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 02:42:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:55 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239
Apr 16 02:42:55 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:56 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239" returned: 0 in 0.877s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:56 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_58cf0bvcdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:42:56 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Converted 112.00 MB image at 112.00 MB/s
Apr 16 02:42:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:56 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 1G
Apr 16 02:42:56 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:56 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 1G" returned: 0 in 0.434s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[46deadf9-98a6-485d-8029-cac7f0078252]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:56 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239
Apr 16 02:42:56 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:57 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239" returned: 0 in 0.493s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:57 devstack sudo[90110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239
Apr 16 02:42:57 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:57 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239" returned: 1 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Downloaded image e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume f0659d12-af5d-46fb-b214-d3a2f2d86239 successfully. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 for user a8e7e5f12d524daabef9a5d823030bf3 is deleted. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Marking volume f0659d12-af5d-46fb-b214-d3a2f2d86239 as bootable. {{(pid=83205) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Copying metadata from image e278c10c-b2af-4a05-aacb-8b1a6716d838 to f0659d12-af5d-46fb-b214-d3a2f2d86239. {{(pid=83205) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Creating volume glance metadata for volume f0659d12-af5d-46fb-b214-d3a2f2d86239 backed by image e278c10c-b2af-4a05-aacb-8b1a6716d838 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83205) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01ce792-b7eb-44af-806f-e26ff7180e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0659d12-af5d-46fb-b214-d3a2f2d86239', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d008b3df0>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954fc919-f798-4639-87c4-daa38e96e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:42:57 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Volume volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 (f0659d12-af5d-46fb-b214-d3a2f2d86239): created successfully
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954fc919-f798-4639-87c4-daa38e96e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:42:57 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Flow 'volume_create_manager' (b94e138a-88f3-42ef-8772-12fc1d960314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:42:57 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d78cc3ef-70f3-4360-a249-cc39d785344a tempest-VolumesImageMetadata-2033184022 None] Created volume successfully.
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Acquiring lock "cinder-f0659d12-af5d-46fb-b214-d3a2f2d86239-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Lock "cinder-f0659d12-af5d-46fb-b214-d3a2f2d86239-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Acquiring lock "cinder-quobyte-f0659d12-af5d-46fb-b214-d3a2f2d86239" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Lock "cinder-quobyte-f0659d12-af5d-46fb-b214-d3a2f2d86239" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698e413-63b0-4f70-8e10-15913bca2bb5]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:58 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239
Apr 16 02:42:58 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:58 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239" returned: 0 in 0.474s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:58 devstack sudo[90119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239
Apr 16 02:42:58 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:59 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239" returned: 1 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:59 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239
Apr 16 02:42:59 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:42:59 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f0659d12-af5d-46fb-b214-d3a2f2d86239" returned: 0 in 0.418s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Lock "cinder-quobyte-f0659d12-af5d-46fb-b214-d3a2f2d86239" released by "delete_volume" :: held 1.419s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Created reservations ['9a00ef07-1103-41df-bdbb-84d27ea137df', '8aff1cbb-bf03-4bae-90db-d1d47c7e8589', '818d82c6-3b6e-4573-a840-fe333efa9ca8', 'c2137ef7-1cde-4ec2-a5bb-53e2ff5406d4'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:42:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:42:59 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:42:59 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:00 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.408s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:43:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Deleted volume successfully.
Apr 16 02:43:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d92c326b-4d5b-4f28-a4c2-443b1f1d03ca tempest-VolumesImageMetadata-2033184022 None] Lock "cinder-f0659d12-af5d-46fb-b214-d3a2f2d86239-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=139,cinder:UPDATE=171,cinder:INSERT=44,cinder:DELETE=12 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=137,cinder:UPDATE=182,cinder:INSERT=65,cinder:DELETE=15 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Flow 'volume_create_manager' (40266d74-0931-4999-ac64-8d63b7a6af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5350371b-2bf0-4aae-aefc-d76967c91f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5350371b-2bf0-4aae-aefc-d76967c91f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1134025741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7ee24e-4650-412c-9e76-87fde6a90212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c32bd472dc7446d89ed0bee8d86285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:02Z,use_quota=True,user_id='b20a97d6b6d4497d929db36e8ae28643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1fd61c-f791-4d72-b3a7-1d49ca5a49ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1fd61c-f791-4d72-b3a7-1d49ca5a49ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d148e6-0cb8-4675-85da-395baa280251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d148e6-0cb8-4675-85da-395baa280251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e7ee24e-4650-412c-9e76-87fde6a90212', 'volume_name': 'volume-6e7ee24e-4650-412c-9e76-87fde6a90212', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952f1508-c817-436f-b433-a4ef02c36aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952f1508-c817-436f-b433-a4ef02c36aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a427ff1a-8bda-4d99-91de-82ba1b453041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:02 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Volume 6e7ee24e-4650-412c-9e76-87fde6a90212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e7ee24e-4650-412c-9e76-87fde6a90212', 'volume_size': 1}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1134025741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e7ee24e-4650-412c-9e76-87fde6a90212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c32bd472dc7446d89ed0bee8d86285a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:02Z,use_quota=True,user_id='b20a97d6b6d4497d929db36e8ae28643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Creating volume 6e7ee24e-4650-412c-9e76-87fde6a90212 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:02 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:02 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212 1073741824
Apr 16 02:43:02 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:02 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212 1073741824" returned: 0 in 0.504s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:03 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212
Apr 16 02:43:03 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:03 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a427ff1a-8bda-4d99-91de-82ba1b453041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e7ee24e-4650-412c-9e76-87fde6a90212', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4262ebfb-f907-4a9b-810f-360056277240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:03 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Volume volume-6e7ee24e-4650-412c-9e76-87fde6a90212 (6e7ee24e-4650-412c-9e76-87fde6a90212): created successfully
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4262ebfb-f907-4a9b-810f-360056277240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:03 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Flow 'volume_create_manager' (40266d74-0931-4999-ac64-8d63b7a6af44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e97a88f2-4eaa-4a69-8c47-fd0b6af1dfd1 tempest-AbsoluteLimitsTests-1281921378 None] Created volume successfully.
Apr 16 02:43:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Acquiring lock "cinder-6e7ee24e-4650-412c-9e76-87fde6a90212-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Lock "cinder-6e7ee24e-4650-412c-9e76-87fde6a90212-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Acquiring lock "cinder-quobyte-6e7ee24e-4650-412c-9e76-87fde6a90212" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Lock "cinder-quobyte-6e7ee24e-4650-412c-9e76-87fde6a90212" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:04 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ed2e4-6385-44df-8c5d-610866b8edc4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:04 devstack sudo[90174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212
Apr 16 02:43:04 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:05 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212" returned: 0 in 0.484s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:05 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212
Apr 16 02:43:05 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:05 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-6e7ee24e-4650-412c-9e76-87fde6a90212" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Lock "cinder-quobyte-6e7ee24e-4650-412c-9e76-87fde6a90212" released by "delete_volume" :: held 0.966s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Created reservations ['bf45ec37-df09-4662-af44-a5a0f6601736', 'fd0a5213-2fad-447f-ab23-739a9801d6e7', '7707c71a-cfad-4242-be9f-4f21870b7824', '3f14fcb4-ab98-4db8-b953-a696023147d0'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:05 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:43:05 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:06 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.430s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:06 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:43:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Deleted volume successfully.
Apr 16 02:43:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-f7b76090-afbe-457d-a909-a727649b24e6 tempest-AbsoluteLimitsTests-1281921378 None] Lock "cinder-6e7ee24e-4650-412c-9e76-87fde6a90212-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Flow 'volume_create_manager' (e3180b63-c0ab-4ef1-9e28-c0893c02f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af909bf9-a789-4ce2-9a43-6bb75dba532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af909bf9-a789-4ce2-9a43-6bb75dba532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-15656405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd0c6d1a04f43d59af690fde6f61197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:08Z,use_quota=True,user_id='ed93c2567bb340e7a3538306d6354f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78feef9d-10d0-4f2b-b0e2-eb21a8ff351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78feef9d-10d0-4f2b-b0e2-eb21a8ff351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e19b4c3-df4c-4ba1-80bf-e77b98670a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.image.glance [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Creating Keystone auth plugin from conf {{(pid=83205) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e19b4c3-df4c-4ba1-80bf-e77b98670a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc', 'volume_name': 'volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d00c4a5f0>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43459c98-b16a-488c-b1cc-87432581ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43459c98-b16a-488c-b1cc-87432581ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e921efa3-c26b-4fc2-9af6-34993182ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:08 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Volume ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d00c4a5f0>}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Trying to clone ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc from image e278c10c-b2af-4a05-aacb-8b1a6716d838 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]). {{(pid=83205) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 16 02:43:08 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Image download 20.69 MB at 20.69 MB/s
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[95523d76-6a3c-4095-88fe-f2a28b639b75]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:08 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD
Apr 16 02:43:08 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:09 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 is fetched for user ed93c2567bb340e7a3538306d6354f7b. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe93878-4b7e-4150-884b-0f13198df0a9]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:09 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD
Apr 16 02:43:09 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:09 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-15656405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd0c6d1a04f43d59af690fde6f61197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:08Z,use_quota=True,user_id='ed93c2567bb340e7a3538306d6354f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Creating volume ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:09 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:09 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 1073741824
Apr 16 02:43:09 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:10 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 1073741824" returned: 0 in 0.481s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:10 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:10 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:10 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 0 in 0.428s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Attempting download of e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1718503-4ab7-4b55-bac2-9645ee81f783]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_1hoe4lbr {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:10 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_1hoe4lbr
Apr 16 02:43:10 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:11 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_1hoe4lbr" returned: 0 in 0.457s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_1hoe4lbr {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:11 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_1hoe4lbr
Apr 16 02:43:11 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:11 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_1hoe4lbr" returned: 1 in 0.467s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e278c10c-b2af-4a05-aacb-8b1a6716d838_1hoe4lbr' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:43:11 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b80be-8bf9-4ced-a2b0-d2963899c082]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:11 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD
Apr 16 02:43:11 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:12 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:12 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] e278c10c-b2af-4a05-aacb-8b1a6716d838 was qcow2, converting to raw {{(pid=83205) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 16 02:43:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:12 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:12 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:12 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 0 in 0.843s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:12 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e278c10c-b2af-4a05-aacb-8b1a6716d838_hyjcm3q8devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:43:12 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Converted 112.00 MB image at 112.00 MB/s
Apr 16 02:43:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:12 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 1G
Apr 16 02:43:12 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:13 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 1G" returned: 0 in 0.424s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:13 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ab7c2c-4a90-4af5-870e-34984e131f2f]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:13 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:13 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:13 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 0 in 0.479s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:13 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:13 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:14 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 1 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Downloaded image e278c10c-b2af-4a05-aacb-8b1a6716d838 ((None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}])) to volume ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc successfully. {{(pid=83205) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Temporary image e278c10c-b2af-4a05-aacb-8b1a6716d838 for user ed93c2567bb340e7a3538306d6354f7b is deleted. {{(pid=83205) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.volume_utils [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Marking volume ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc as bootable. {{(pid=83205) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Copying metadata from image e278c10c-b2af-4a05-aacb-8b1a6716d838 to ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc. {{(pid=83205) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Creating volume glance metadata for volume ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc backed by image e278c10c-b2af-4a05-aacb-8b1a6716d838 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83205) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e921efa3-c26b-4fc2-9af6-34993182ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc', 'volume_size': 1, 'image_id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e278c10c-b2af-4a05-aacb-8b1a6716d838', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e00c7030ae4ee9a3f50fe47f608d59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e278c10c-b2af-4a05-aacb-8b1a6716d838', 'created_at': datetime.datetime(2026, 4, 16, 0, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 0, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e278c10c-b2af-4a05-aacb-8b1a6716d838/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3d00c4a5f0>}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e766fdc2-201c-44be-a1cd-34e60aef423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Volume volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc (ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc): created successfully
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e766fdc2-201c-44be-a1cd-34e60aef423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Flow 'volume_create_manager' (e3180b63-c0ab-4ef1-9e28-c0893c02f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:14 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-492bd300-d9a8-4e2f-a69e-f2b46e4a38ea tempest-VolumesExtendTest-1207197170 None] Created volume successfully.
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2b46ec-a703-4a07-a8d6-81db4bc981b9]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:14 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:14 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:15 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 0 in 0.489s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:15 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:15 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:15 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 1 in 0.528s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:43:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 2G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc 2G" returned: 0 in 0.049s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.099s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:15 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ca421fe8-8d9c-405a-8b9c-9f57b259ef2a tempest-VolumesExtendTest-1207197170 None] Extend volume completed successfully.
Apr 16 02:43:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Acquiring lock "cinder-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Lock "cinder-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Acquiring lock "cinder-quobyte-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[776d16a5-235b-43f6-90d2-66bb36d84b95]: (4, 'raw') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:17 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:17 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:17 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 0 in 0.476s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:17 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:17 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:17 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 1 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc' failed. Not Retrying. {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 16 02:43:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:17 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc
Apr 16 02:43:17 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:18 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" returned: 0 in 0.426s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc" released by "delete_volume" :: held 1.410s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Created reservations ['edb2fcee-3db0-4742-a940-ba67edc2211c', 'a55c878e-2760-49a9-940e-1d10d8a61742', '0db3f027-d1c0-4fe8-83c8-434d8ef95909', '14d18d3a-ca06-4a00-8f3d-e657e00526ef'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:18 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:43:18 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:18 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.400s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:43:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Deleted volume successfully.
Apr 16 02:43:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-dba1c8dd-515b-42cf-9968-eb8bca16a309 tempest-VolumesExtendTest-1207197170 None] Lock "cinder-ff1cfb99-4ca6-46a3-bbbb-e9c42becdefc-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Flow 'volume_create_manager' (5dc9b8d3-24e9-49ea-804d-23066d043de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5763eb46-55b4-4113-9461-f22dafe09581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5763eb46-55b4-4113-9461-f22dafe09581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-911031848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fe28c9-7b2d-4b09-8e60-f9e01a830abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd0c6d1a04f43d59af690fde6f61197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:19Z,use_quota=True,user_id='ed93c2567bb340e7a3538306d6354f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3326165e-57f2-4491-a058-ce674b291c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3326165e-57f2-4491-a058-ce674b291c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562d3d69-b186-4417-b9bc-a69906c40650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562d3d69-b186-4417-b9bc-a69906c40650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fe28c9-7b2d-4b09-8e60-f9e01a830abc', 'volume_name': 'volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0760e4bd-2136-4b15-98a2-cd0414967288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0760e4bd-2136-4b15-98a2-cd0414967288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabebf77-6a53-4ec1-9f63-f83396a13bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:19 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Volume 09fe28c9-7b2d-4b09-8e60-f9e01a830abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc', 'volume_size': 1}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-911031848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fe28c9-7b2d-4b09-8e60-f9e01a830abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd0c6d1a04f43d59af690fde6f61197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:19Z,use_quota=True,user_id='ed93c2567bb340e7a3538306d6354f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Creating volume 09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:19 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:19 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc 1073741824
Apr 16 02:43:19 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:19 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc 1073741824" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:19 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc
Apr 16 02:43:19 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:20 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" returned: 0 in 0.397s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabebf77-6a53-4ec1-9f63-f83396a13bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e96f955-9437-4110-a4f8-65fd1178f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:20 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Volume volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc (09fe28c9-7b2d-4b09-8e60-f9e01a830abc): created successfully
Apr 16 02:43:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e96f955-9437-4110-a4f8-65fd1178f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:20 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Flow 'volume_create_manager' (5dc9b8d3-24e9-49ea-804d-23066d043de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:20 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-aec115ea-380f-4bb9-8a05-360f20128b40 tempest-VolumesExtendTest-1207197170 None] Created volume successfully.
Apr 16 02:43:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Creating offline snapshot 229d7a65-96d1-483f-9c9e-01046a579f77 of volume 09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:43:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb346340-bc5e-41c2-9715-a0f5a6b636d2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:21 devstack sudo[90281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc
Apr 16 02:43:21 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:22 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" returned: 0 in 0.474s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:22 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 1G
Apr 16 02:43:22 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:22 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 1G" returned: 0 in 0.503s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:22 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77
Apr 16 02:43:22 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:22 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77" returned: 0 in 0.438s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:22 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 is being set with open permissions: ugo+rw
Apr 16 02:43:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:23 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77
Apr 16 02:43:23 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:23 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77" returned: 0 in 0.412s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:23 devstack sudo[90299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.info
Apr 16 02:43:23 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:23 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.info" returned: 0 in 0.415s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:23 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.info is being set with open permissions: ugo+rw
Apr 16 02:43:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:23 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.info
Apr 16 02:43:23 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:24 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.info" returned: 0 in 0.404s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8726d7a2-4622-49df-9e0d-c08afadc4504 tempest-VolumesExtendTest-1207197170 None] Create snapshot completed successfully
Apr 16 02:43:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:24 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8cdf8-7a20-461b-b0d1-93d9dc0d9cc7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:24 devstack sudo[90306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc
Apr 16 02:43:24 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:25 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 2G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 2G" returned: 0 in 0.072s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.581s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-130f45b5-79e1-4053-b456-493183efaafc tempest-VolumesExtendTest-1207197170 None] Extend volume completed successfully.
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Acquiring lock "cinder-229d7a65-96d1-483f-9c9e-01046a579f77-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Lock "cinder-229d7a65-96d1-483f-9c9e-01046a579f77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Acquiring lock "cinder-quobyte-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Acquiring lock "cinder-quobyte-229d7a65-96d1-483f-9c9e-01046a579f77" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-229d7a65-96d1-483f-9c9e-01046a579f77" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Deleting offline snapshot 229d7a65-96d1-483f-9c9e-01046a579f77 of volume 09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] snapshot_file for this snap is: volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed51856-f169-450a-a31b-30afeb2a832e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:26 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77
Apr 16 02:43:26 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:26 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:43:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3443b09d-c1b9-4ae4-b40d-ff6066aa0bbf]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:26 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc
Apr 16 02:43:26 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:26 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:26 devstack sudo[90324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77
Apr 16 02:43:26 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:27 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77" returned: 0 in 0.486s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:27 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77
Apr 16 02:43:27 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:27 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc.229d7a65-96d1-483f-9c9e-01046a579f77" returned: 0 in 0.422s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-229d7a65-96d1-483f-9c9e-01046a579f77" released by "_delete_snapshot" :: held 1.879s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" released by "delete_snapshot" :: held 1.890s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:27 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Created reservations ['9a6a01d8-2661-4e83-81ca-11f1a3085b35', 'cdd7614e-4107-40e3-adef-6c053e44d3d5', '7c6b07b2-310b-4e0f-b45a-46303b8370cf', '6705ec4c-7dd9-4808-a161-7ad81e39e809'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Delete snapshot completed successfully.
Apr 16 02:43:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-ce4d8c52-5edf-4a6b-9d78-94ab2a289ded tempest-VolumesExtendTest-1207197170 None] Lock "cinder-229d7a65-96d1-483f-9c9e-01046a579f77-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Acquiring lock "cinder-09fe28c9-7b2d-4b09-8e60-f9e01a830abc-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Lock "cinder-09fe28c9-7b2d-4b09-8e60-f9e01a830abc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Acquiring lock "cinder-quobyte-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[101adf91-7109-4f45-b60a-40961ba3e4af]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:28 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc
Apr 16 02:43:28 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:28 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" returned: 0 in 0.483s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:28 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc
Apr 16 02:43:28 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:29 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" returned: 0 in 0.404s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Lock "cinder-quobyte-09fe28c9-7b2d-4b09-8e60-f9e01a830abc" released by "delete_volume" :: held 0.919s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Created reservations ['0969dd8c-c0d8-432a-a210-9917eaf97a9e', '8d3833e6-8d34-4201-acd9-aa62b09985bf', '690090a3-d726-448c-ad53-8ecb23073da8', 'e1af5ede-5068-4346-8667-63e951ef8dbb'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:29 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:43:29 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:29 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.448s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:43:29 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Deleted volume successfully.
Apr 16 02:43:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e4e93da7-9ced-48c1-8802-b0617f3bd3cc tempest-VolumesExtendTest-1207197170 None] Lock "cinder-09fe28c9-7b2d-4b09-8e60-f9e01a830abc-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Flow 'volume_create_manager' (345e1696-5dd8-4be5-9651-1fa501d20062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e7fd73-1f58-41dd-95b3-d2652de6b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e7fd73-1f58-41dd-95b3-d2652de6b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1815432616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85726385-309c-4c85-93d0-b31ec3e99909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caabd3a11b304f469efae581bc362d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:31Z,use_quota=True,user_id='ae97a095e6654e808ad76b0f1ffa231b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c46ed6f-a768-41ba-8ded-796f8dcb94d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c46ed6f-a768-41ba-8ded-796f8dcb94d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67ff7a3-4e87-490d-a58c-864c3f27f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67ff7a3-4e87-490d-a58c-864c3f27f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85726385-309c-4c85-93d0-b31ec3e99909', 'volume_name': 'volume-85726385-309c-4c85-93d0-b31ec3e99909', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a998b1-38b9-44d7-92f4-d7c4bffef2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a998b1-38b9-44d7-92f4-d7c4bffef2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288b7696-f79d-4dfa-96ac-39d15ee4060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:30 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Volume 85726385-309c-4c85-93d0-b31ec3e99909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85726385-309c-4c85-93d0-b31ec3e99909', 'volume_size': 1}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1815432616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85726385-309c-4c85-93d0-b31ec3e99909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caabd3a11b304f469efae581bc362d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:31Z,use_quota=True,user_id='ae97a095e6654e808ad76b0f1ffa231b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Creating volume 85726385-309c-4c85-93d0-b31ec3e99909 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:30 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:30 devstack sudo[90344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909 1073741824
Apr 16 02:43:30 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:31 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909 1073741824" returned: 0 in 0.470s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:31 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909
Apr 16 02:43:31 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:31 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909" returned: 0 in 0.405s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288b7696-f79d-4dfa-96ac-39d15ee4060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85726385-309c-4c85-93d0-b31ec3e99909', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed54fd00-6331-4f7c-8d7e-41de451baadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:31 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Volume volume-85726385-309c-4c85-93d0-b31ec3e99909 (85726385-309c-4c85-93d0-b31ec3e99909): created successfully
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed54fd00-6331-4f7c-8d7e-41de451baadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:31 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Flow 'volume_create_manager' (345e1696-5dd8-4be5-9651-1fa501d20062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-57895e84-26a5-4291-a876-f69221f78343 tempest-VolumesListTestJSON-138035515 None] Created volume successfully.
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Flow 'volume_create_manager' (12b9a861-5b52-4049-94df-f42249f268f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b284d518-54c8-4194-9a4f-67ade1f9c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b284d518-54c8-4194-9a4f-67ade1f9c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285637620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb061a6f-572b-4ec6-bd5b-5a4dea488c57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caabd3a11b304f469efae581bc362d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:33Z,use_quota=True,user_id='ae97a095e6654e808ad76b0f1ffa231b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f27d09-1dd8-46f8-9e85-e24c7250dc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f27d09-1dd8-46f8-9e85-e24c7250dc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b11038-f234-44dc-acf0-220abb9b1367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b11038-f234-44dc-acf0-220abb9b1367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb061a6f-572b-4ec6-bd5b-5a4dea488c57', 'volume_name': 'volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08009c4-d287-4201-9b8a-9dc5d92316e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08009c4-d287-4201-9b8a-9dc5d92316e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35ff94a-b33e-4310-aca7-695b8542951e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:33 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Volume cb061a6f-572b-4ec6-bd5b-5a4dea488c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57', 'volume_size': 1}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-285637620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb061a6f-572b-4ec6-bd5b-5a4dea488c57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caabd3a11b304f469efae581bc362d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:33Z,use_quota=True,user_id='ae97a095e6654e808ad76b0f1ffa231b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Creating volume cb061a6f-572b-4ec6-bd5b-5a4dea488c57 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:33 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:33 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57 1073741824
Apr 16 02:43:33 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:33 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57 1073741824" returned: 0 in 0.474s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:33 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57
Apr 16 02:43:33 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:34 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57" returned: 0 in 0.404s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35ff94a-b33e-4310-aca7-695b8542951e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbd2775-5371-4208-9dcf-76b928b5e99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:34 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Volume volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57 (cb061a6f-572b-4ec6-bd5b-5a4dea488c57): created successfully
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbd2775-5371-4208-9dcf-76b928b5e99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Flow 'volume_create_manager' (12b9a861-5b52-4049-94df-f42249f268f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:34 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f2429c32-9852-4f55-8544-8a1dc24cde9f tempest-VolumesListTestJSON-138035515 None] Created volume successfully.
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Flow 'volume_create_manager' (324468c3-b15d-48c0-bba8-e46b6f2fb76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2893bf3-2697-41bd-987b-30935ac027fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2893bf3-2697-41bd-987b-30935ac027fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-731271167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348164ff-1e1a-4216-b776-77404ec13a88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caabd3a11b304f469efae581bc362d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:35Z,use_quota=True,user_id='ae97a095e6654e808ad76b0f1ffa231b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17850c0-3ad7-4c1e-b8c8-b7989d75516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17850c0-3ad7-4c1e-b8c8-b7989d75516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd49886d-8f89-465d-9d99-9a50865d1dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd49886d-8f89-465d-9d99-9a50865d1dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348164ff-1e1a-4216-b776-77404ec13a88', 'volume_name': 'volume-348164ff-1e1a-4216-b776-77404ec13a88', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff2d314-a2ce-4a06-9a5c-f0a975dae2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff2d314-a2ce-4a06-9a5c-f0a975dae2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e07ba3-f21b-4e12-84e0-94493c644741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:34 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Volume 348164ff-1e1a-4216-b776-77404ec13a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348164ff-1e1a-4216-b776-77404ec13a88', 'volume_size': 1}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-731271167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348164ff-1e1a-4216-b776-77404ec13a88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='caabd3a11b304f469efae581bc362d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:35Z,use_quota=True,user_id='ae97a095e6654e808ad76b0f1ffa231b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Creating volume 348164ff-1e1a-4216-b776-77404ec13a88 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:34 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:34 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88 1073741824
Apr 16 02:43:34 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:35 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88 1073741824" returned: 0 in 0.468s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:35 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88
Apr 16 02:43:35 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:35 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88" returned: 0 in 0.412s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e07ba3-f21b-4e12-84e0-94493c644741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348164ff-1e1a-4216-b776-77404ec13a88', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ebf9c5-bf7f-4c86-91f2-6cc027b55c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:35 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Volume volume-348164ff-1e1a-4216-b776-77404ec13a88 (348164ff-1e1a-4216-b776-77404ec13a88): created successfully
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ebf9c5-bf7f-4c86-91f2-6cc027b55c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Flow 'volume_create_manager' (324468c3-b15d-48c0-bba8-e46b6f2fb76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8ba9d89c-b058-4a0a-819e-a27848fda80b tempest-VolumesListTestJSON-138035515 None] Created volume successfully.
Apr 16 02:43:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "cinder-348164ff-1e1a-4216-b776-77404ec13a88-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-348164ff-1e1a-4216-b776-77404ec13a88-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "cinder-quobyte-348164ff-1e1a-4216-b776-77404ec13a88" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-quobyte-348164ff-1e1a-4216-b776-77404ec13a88" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:38 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb82571e-a4e7-4635-9669-105501416847]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:38 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88
Apr 16 02:43:38 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:39 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88" returned: 0 in 0.458s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:39 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88
Apr 16 02:43:39 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:39 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-348164ff-1e1a-4216-b776-77404ec13a88" returned: 0 in 0.422s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-quobyte-348164ff-1e1a-4216-b776-77404ec13a88" released by "delete_volume" :: held 0.902s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Created reservations ['02999e3e-8f1a-45ce-a0a8-3a27d51c5001', '0145184c-e288-48a7-ac9c-3e5f8c9b12fa', 'cc06ab25-0224-4efa-8125-6c56f47b37b7', '5643d5ed-5d35-4229-9ddf-ea80e660891f'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:39 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:43:39 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Acquiring lock "cinder-cb061a6f-572b-4ec6-bd5b-5a4dea488c57-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Lock "cinder-cb061a6f-572b-4ec6-bd5b-5a4dea488c57-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Acquiring lock "cinder-quobyte-cb061a6f-572b-4ec6-bd5b-5a4dea488c57" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Lock "cinder-quobyte-cb061a6f-572b-4ec6-bd5b-5a4dea488c57" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9154d-c709-4754-a91c-fa60812ddbce]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:39 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57
Apr 16 02:43:39 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:40 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.454s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:43:40 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Deleted volume successfully.
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76d8f3c0-a44d-4853-a8ab-67327d5f7886 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-348164ff-1e1a-4216-b776-77404ec13a88-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:40 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57" returned: 0 in 0.500s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:40 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57
Apr 16 02:43:40 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:40 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-cb061a6f-572b-4ec6-bd5b-5a4dea488c57" returned: 0 in 0.425s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Lock "cinder-quobyte-cb061a6f-572b-4ec6-bd5b-5a4dea488c57" released by "delete_volume" :: held 0.949s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:40 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Created reservations ['d4c0e858-40aa-427c-a8f5-a68bb08231d0', 'ee70cf41-5aac-449e-8e76-babe88955485', 'd79f2d33-0003-4a34-ac70-b8d51143df81', '185bac36-a0a7-4337-91c9-db07f3303443'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:41 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:43:41 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:41 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.410s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:43:41 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Deleted volume successfully.
Apr 16 02:43:41 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-288e0273-75dd-4d11-9ad0-eda0ec5c61af tempest-VolumesListTestJSON-138035515 None] Lock "cinder-cb061a6f-572b-4ec6-bd5b-5a4dea488c57-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "cinder-85726385-309c-4c85-93d0-b31ec3e99909-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-85726385-309c-4c85-93d0-b31ec3e99909-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "cinder-quobyte-85726385-309c-4c85-93d0-b31ec3e99909" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-quobyte-85726385-309c-4c85-93d0-b31ec3e99909" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce7e5f6-252d-456e-b166-ecc398dfe4d8]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:42 devstack sudo[90393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909
Apr 16 02:43:42 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:42 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909" returned: 0 in 0.470s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:42 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909
Apr 16 02:43:42 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:43 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-85726385-309c-4c85-93d0-b31ec3e99909" returned: 0 in 0.403s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-quobyte-85726385-309c-4c85-93d0-b31ec3e99909" released by "delete_volume" :: held 0.895s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Created reservations ['015690da-54d0-46c3-95b9-40ec6d0b38d6', 'edb1d67f-9b51-4cf6-ab44-29f98b923d02', 'fce68696-b0c8-493a-af34-f3f49c8a1f34', '3a83389b-37d5-484b-a989-52fd23408bd5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:43 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:43:43 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:43 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.475s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:43:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Deleted volume successfully.
Apr 16 02:43:43 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-49a79985-7a1d-4874-bdf0-517d1e4732e1 tempest-VolumesListTestJSON-138035515 None] Lock "cinder-85726385-309c-4c85-93d0-b31ec3e99909-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (68f9ab38-7c34-450d-bea5-93b9e234c5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a703deaa-f358-4b3a-a35f-bb3def4483d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a703deaa-f358-4b3a-a35f-bb3def4483d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1028238027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9938c314-2f01-4852-b0a2-f9dbfa4eb8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:50Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139f836e-924e-4d81-ad22-beea4d618ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139f836e-924e-4d81-ad22-beea4d618ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa235f0-ff8d-4449-b602-e6ae568abaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa235f0-ff8d-4449-b602-e6ae568abaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9938c314-2f01-4852-b0a2-f9dbfa4eb8fd', 'volume_name': 'volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1aaba3-867f-4812-8efc-ac6b094eb71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c1aaba3-867f-4812-8efc-ac6b094eb71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e266fd4f-3dc1-4203-b2cf-ede7d2b4514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:50 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume 9938c314-2f01-4852-b0a2-f9dbfa4eb8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd', 'volume_size': 1}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1028238027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9938c314-2f01-4852-b0a2-f9dbfa4eb8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:50Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Creating volume 9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:50 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:50 devstack sudo[90405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd 1073741824
Apr 16 02:43:50 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:51 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd 1073741824" returned: 0 in 0.503s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:51 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd
Apr 16 02:43:51 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:51 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" returned: 0 in 0.439s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e266fd4f-3dc1-4203-b2cf-ede7d2b4514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef627e9d-41a4-41e0-ae1f-10c1510ff6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:51 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd (9938c314-2f01-4852-b0a2-f9dbfa4eb8fd): created successfully
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef627e9d-41a4-41e0-ae1f-10c1510ff6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (68f9ab38-7c34-450d-bea5-93b9e234c5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-564ef51d-3a36-456e-96bf-7e32206865e5 tempest-VolumesSnapshotTestJSON-1743381734 None] Created volume successfully.
Apr 16 02:43:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Creating offline snapshot c5d33d96-cc64-4355-86fc-0ba38d99cbd7 of volume 9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:43:52 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fd79ca-542f-4303-8a7e-133c7fb01027]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:52 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd
Apr 16 02:43:52 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:53 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" returned: 0 in 0.484s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:53 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 1G
Apr 16 02:43:53 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:53 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 1G" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:53 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7
Apr 16 02:43:53 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:54 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7" returned: 0 in 0.437s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:54 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 is being set with open permissions: ugo+rw
Apr 16 02:43:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:54 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7
Apr 16 02:43:54 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:54 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7" returned: 0 in 0.396s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:54 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.info
Apr 16 02:43:54 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:54 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.info" returned: 0 in 0.404s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:54 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.info is being set with open permissions: ugo+rw
Apr 16 02:43:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:55 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.info
Apr 16 02:43:55 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:55 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.info" returned: 0 in 0.400s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:55 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-fe2027dc-0466-4a17-a107-28ab102912f9 tempest-VolumesSnapshotTestJSON-1743381734 None] Create snapshot completed successfully
Apr 16 02:43:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-c5d33d96-cc64-4355-86fc-0ba38d99cbd7-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-c5d33d96-cc64-4355-86fc-0ba38d99cbd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-c5d33d96-cc64-4355-86fc-0ba38d99cbd7" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-c5d33d96-cc64-4355-86fc-0ba38d99cbd7" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Deleting offline snapshot c5d33d96-cc64-4355-86fc-0ba38d99cbd7 of volume 9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] snapshot_file for this snap is: volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d4ce1-7765-4571-a6b5-95f9fb7b0559]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:56 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7
Apr 16 02:43:56 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:56 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7" returned: 0 in 0.469s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae90668-e65c-4768-9ed7-11c2785ae3a3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:56 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd
Apr 16 02:43:56 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:56 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:57 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7
Apr 16 02:43:57 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:57 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7" returned: 0 in 0.449s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:57 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7
Apr 16 02:43:57 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:57 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd.c5d33d96-cc64-4355-86fc-0ba38d99cbd7" returned: 0 in 0.395s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-c5d33d96-cc64-4355-86fc-0ba38d99cbd7" released by "_delete_snapshot" :: held 1.827s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" released by "delete_snapshot" :: held 1.836s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['37c33c17-806d-436a-8da6-9710880b6067', '45d3ca1d-2c30-43d6-8f95-85ea57f9ef61', '06753759-4692-46d2-b468-62ad90fd6884', '8144f2ee-99bd-43d0-8e48-5a1a22474479'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:43:57 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Delete snapshot completed successfully.
Apr 16 02:43:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a8c8c1de-60d1-4596-b85f-826c3691648f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-c5d33d96-cc64-4355-86fc-0ba38d99cbd7-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (078f002a-a630-47cb-8d4b-8ae9ba932a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eca4f92-490b-45ef-b353-ef7a3bbc5ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eca4f92-490b-45ef-b353-ef7a3bbc5ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-700433675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe924cf-77e6-478d-976f-242bbfe2b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:58Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15ed8ff-b9ee-4754-8504-9afc1ff6d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15ed8ff-b9ee-4754-8504-9afc1ff6d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d03999-dd55-4434-b911-0447dd8e4fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d03999-dd55-4434-b911-0447dd8e4fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe924cf-77e6-478d-976f-242bbfe2b77e', 'volume_name': 'volume-afe924cf-77e6-478d-976f-242bbfe2b77e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288be795-e66c-4b42-9959-561157f2fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288be795-e66c-4b42-9959-561157f2fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc38a8d9-8d42-49ab-8e46-b232eac0f073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:58 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume afe924cf-77e6-478d-976f-242bbfe2b77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe924cf-77e6-478d-976f-242bbfe2b77e', 'volume_size': 1}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-700433675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe924cf-77e6-478d-976f-242bbfe2b77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:43:58Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Creating volume afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:43:58 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:58 devstack sudo[90463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e 1073741824
Apr 16 02:43:58 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:58 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e 1073741824" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:58 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e
Apr 16 02:43:58 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:43:59 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e" returned: 0 in 0.421s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc38a8d9-8d42-49ab-8e46-b232eac0f073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe924cf-77e6-478d-976f-242bbfe2b77e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8630047-efb9-4d4c-9997-42780c8cdbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:43:59 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume volume-afe924cf-77e6-478d-976f-242bbfe2b77e (afe924cf-77e6-478d-976f-242bbfe2b77e): created successfully
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8630047-efb9-4d4c-9997-42780c8cdbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (078f002a-a630-47cb-8d4b-8ae9ba932a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:43:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-7efae283-99c7-41b9-b989-0df316d1bbb9 tempest-VolumesSnapshotTestJSON-1743381734 None] Created volume successfully.
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:43:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:43:59 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:43:59 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:00 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.415s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Creating offline snapshot 0b3e853c-45e8-45de-9dda-80c3da3f9d99 of volume afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:44:00 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7272549-1c53-4f26-95ba-99d5aaea8f9c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:00 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e
Apr 16 02:44:00 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:01 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e" returned: 0 in 0.551s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:01 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 1G
Apr 16 02:44:01 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:01 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 1G" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe924cf-77e6-478d-976f-242bbfe2b77e -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:01 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe924cf-77e6-478d-976f-242bbfe2b77e -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99
Apr 16 02:44:01 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:02 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe924cf-77e6-478d-976f-242bbfe2b77e -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99" returned: 0 in 0.474s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:02 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 is being set with open permissions: ugo+rw
Apr 16 02:44:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:02 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99
Apr 16 02:44:02 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:02 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99" returned: 0 in 0.438s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:02 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=84,cinder:UPDATE=84,cinder:INSERT=23,cinder:DELETE=13 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:44:02 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=80,cinder:UPDATE=102,cinder:INSERT=32,cinder:DELETE=3 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:44:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:02 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.info
Apr 16 02:44:02 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:03 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.info" returned: 0 in 0.416s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:03 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.info is being set with open permissions: ugo+rw
Apr 16 02:44:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:03 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.info
Apr 16 02:44:03 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:03 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.info" returned: 0 in 0.411s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a89e4f41-647f-422b-8a62-923956de2405 tempest-VolumesSnapshotTestJSON-1743381734 None] Create snapshot completed successfully
Apr 16 02:44:03 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (dc450cc7-7732-4232-bcdb-54a01c541b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c3b429-5672-497f-966c-53357a2719c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c3b429-5672-497f-966c-53357a2719c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-460348108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624dcfa2-e849-4e23-a059-7c72d487831a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0b3e853c-45e8-45de-9dda-80c3da3f9d99,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:04Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad26854e-65fb-4a0f-af22-3ed8dec8131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad26854e-65fb-4a0f-af22-3ed8dec8131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d93f9-7d9f-46b9-a049-c1d7cd345762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d93f9-7d9f-46b9-a049-c1d7cd345762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '624dcfa2-e849-4e23-a059-7c72d487831a', 'volume_name': 'volume-624dcfa2-e849-4e23-a059-7c72d487831a', 'volume_size': 2, 'snapshot_id': '0b3e853c-45e8-45de-9dda-80c3da3f9d99'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92ad7ef-40c9-4cd6-b452-47687d2c8714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92ad7ef-40c9-4cd6-b452-47687d2c8714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78d9288-1e4b-47f0-816f-ff813a4d72a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:04 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Volume 624dcfa2-e849-4e23-a059-7c72d487831a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-624dcfa2-e849-4e23-a059-7c72d487831a', 'volume_size': 2, 'snapshot_id': '0b3e853c-45e8-45de-9dda-80c3da3f9d99'}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-0b3e853c-45e8-45de-9dda-80c3da3f9d99-624dcfa2-e849-4e23-a059-7c72d487831a" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-0b3e853c-45e8-45de-9dda-80c3da3f9d99-624dcfa2-e849-4e23-a059-7c72d487831a" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Creating volume 624dcfa2-e849-4e23-a059-7c72d487831a from snapshot 0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-624dcfa2-e849-4e23-a059-7c72d487831a" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-624dcfa2-e849-4e23-a059-7c72d487831a" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] snapshot: 0b3e853c-45e8-45de-9dda-80c3da3f9d99, volume: 624dcfa2-e849-4e23-a059-7c72d487831a,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5742b196-6527-4ae3-a10c-0bb03fb70072]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:04 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99
Apr 16 02:44:04 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:04 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99" returned: 0 in 0.461s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe924cf-77e6-478d-976f-242bbfe2b77e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a034b916-e90e-4451-a9c6-bbe95d8fb5a4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:04 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e
Apr 16 02:44:04 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:05 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e" returned: 0 in 0.461s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:05 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:44:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:05 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a
Apr 16 02:44:05 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:07 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a" returned: 0 in 2.026s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:07 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6542792f-a925-48a7-8293-79953e123e32]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:07 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e
Apr 16 02:44:07 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:07 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e" returned: 0 in 0.608s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:07 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:44:07 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Converted 1024.00 MB image at 505.02 MB/s
Apr 16 02:44:07 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a is being set with open permissions: ugo+rw
Apr 16 02:44:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:07 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a
Apr 16 02:44:07 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:08 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a" returned: 0 in 0.414s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-624dcfa2-e849-4e23-a059-7c72d487831a" released by "_copy_volume_from_snapshot" :: held 4.024s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-0b3e853c-45e8-45de-9dda-80c3da3f9d99-624dcfa2-e849-4e23-a059-7c72d487831a" released by "_create_volume_from_snapshot" :: held 4.040s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.048s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78d9288-1e4b-47f0-816f-ff813a4d72a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624dcfa2-e849-4e23-a059-7c72d487831a', 'volume_size': 2, 'snapshot_id': '0b3e853c-45e8-45de-9dda-80c3da3f9d99'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcc099c-08fe-461d-98a6-f1bd0fa9b356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:08 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Volume volume-624dcfa2-e849-4e23-a059-7c72d487831a (624dcfa2-e849-4e23-a059-7c72d487831a): created successfully
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcc099c-08fe-461d-98a6-f1bd0fa9b356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (dc450cc7-7732-4232-bcdb-54a01c541b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:08 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-54a5cf59-5e35-4b54-b555-9861ad1274eb tempest-VolumesSnapshotTestJSON-1743381734 None] Created volume successfully.
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-624dcfa2-e849-4e23-a059-7c72d487831a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-624dcfa2-e849-4e23-a059-7c72d487831a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-624dcfa2-e849-4e23-a059-7c72d487831a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-624dcfa2-e849-4e23-a059-7c72d487831a" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511ebb3-f269-4104-b0bb-5b68984e5dbe]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:08 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a
Apr 16 02:44:08 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:08 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a" returned: 0 in 0.477s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:08 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a
Apr 16 02:44:08 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:09 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-624dcfa2-e849-4e23-a059-7c72d487831a" returned: 0 in 0.412s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-624dcfa2-e849-4e23-a059-7c72d487831a" released by "delete_volume" :: held 0.920s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['ac9919fc-223e-461a-a7c1-d067f29411c6', 'df996052-a40f-4117-9df3-667658960a80', '76c9f055-338d-4453-9bc2-24e86a7ecf60', 'ed0bf013-46e0-417a-a7a2-d7ad60a18f6d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:09 devstack sudo[90573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:09 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-0b3e853c-45e8-45de-9dda-80c3da3f9d99-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-0b3e853c-45e8-45de-9dda-80c3da3f9d99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-afe924cf-77e6-478d-976f-242bbfe2b77e" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-afe924cf-77e6-478d-976f-242bbfe2b77e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-0b3e853c-45e8-45de-9dda-80c3da3f9d99" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-0b3e853c-45e8-45de-9dda-80c3da3f9d99" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Deleting offline snapshot 0b3e853c-45e8-45de-9dda-80c3da3f9d99 of volume afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] snapshot_file for this snap is: volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc203c13-7478-40a1-b7e5-04f300971f99]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:09 devstack sudo[90575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99
Apr 16 02:44:09 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:09 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.447s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Deleted volume successfully.
Apr 16 02:44:09 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-eb276769-0d57-4bfa-ab87-f5a593b2526f tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-624dcfa2-e849-4e23-a059-7c72d487831a-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:10 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe924cf-77e6-478d-976f-242bbfe2b77e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:44:10 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28db760-80bc-4c6d-8dc2-8eb9c6b71f1e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:10 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e
Apr 16 02:44:10 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:10 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:10 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99
Apr 16 02:44:10 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:11 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:11 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99
Apr 16 02:44:11 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:11 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e.0b3e853c-45e8-45de-9dda-80c3da3f9d99" returned: 0 in 0.451s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-0b3e853c-45e8-45de-9dda-80c3da3f9d99" released by "_delete_snapshot" :: held 2.019s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-afe924cf-77e6-478d-976f-242bbfe2b77e" released by "delete_snapshot" :: held 2.036s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:11 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['0079a538-7058-4d8b-ba10-2e418e5414a2', '41c22015-cdc3-4db5-9feb-77e30b5ec072', 'aa7dc29e-e077-4597-a8c5-39ce820cb664', '45b568c1-95d1-4409-b570-3916b7d1dc0d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:11 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Delete snapshot completed successfully.
Apr 16 02:44:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a89832e1-baf2-4b48-affd-32ca36998766 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-0b3e853c-45e8-45de-9dda-80c3da3f9d99-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-afe924cf-77e6-478d-976f-242bbfe2b77e-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-afe924cf-77e6-478d-976f-242bbfe2b77e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-afe924cf-77e6-478d-976f-242bbfe2b77e" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:12 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-afe924cf-77e6-478d-976f-242bbfe2b77e" acquired by "delete_volume" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:12 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3681e5cb-a47f-410b-90cb-a5427f1a9636]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:12 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e
Apr 16 02:44:12 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:13 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e" returned: 0 in 0.454s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:13 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e
Apr 16 02:44:13 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:13 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-afe924cf-77e6-478d-976f-242bbfe2b77e" returned: 0 in 0.398s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-afe924cf-77e6-478d-976f-242bbfe2b77e" released by "delete_volume" :: held 0.880s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['1747db69-737a-4a9f-bb1d-a1dd277c2c67', 'e00fa907-2c66-438e-8bcd-d86be354d457', 'eb4b44f1-fb21-40f0-a6fa-c74a91dfa178', '7896d05c-8517-4658-9c4b-9112f889bdee'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:13 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:13 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (e65a5162-59c1-43da-9d97-5754709cb84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3681690-b4be-47bd-a507-7d4893afb336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3681690-b4be-47bd-a507-7d4893afb336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1090029342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4158d4-3183-4e1a-acc1-6d11e2cd2549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:14Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e40db5-591e-44bd-bea2-dcfe353aba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e40db5-591e-44bd-bea2-dcfe353aba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb82a28-6c9d-484a-a17d-40f10c8a703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb82a28-6c9d-484a-a17d-40f10c8a703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4158d4-3183-4e1a-acc1-6d11e2cd2549', 'volume_name': 'volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:14 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8a391c-0350-4c3f-a790-0c5eeed92926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8a391c-0350-4c3f-a790-0c5eeed92926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a233513-0e65-4e9c-ba0c-0678a34a8ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume ed4158d4-3183-4e1a-acc1-6d11e2cd2549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549', 'volume_size': 1}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1090029342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4158d4-3183-4e1a-acc1-6d11e2cd2549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:14Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Creating volume ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:14 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:14 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Deleted volume successfully.
Apr 16 02:44:14 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 1073741824
Apr 16 02:44:14 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e9663550-c49b-45dc-8e8f-988547a44552 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-afe924cf-77e6-478d-976f-242bbfe2b77e-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:14 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 1073741824" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:14 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549
Apr 16 02:44:14 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:15 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" returned: 0 in 0.475s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:44:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a233513-0e65-4e9c-ba0c-0678a34a8ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c93d60-97a6-45fc-b73c-c5268991afdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:15 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Volume volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 (ed4158d4-3183-4e1a-acc1-6d11e2cd2549): created successfully
Apr 16 02:44:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c93d60-97a6-45fc-b73c-c5268991afdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (e65a5162-59c1-43da-9d97-5754709cb84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:15 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c95631e4-f108-479f-bd6a-f978ba63e821 tempest-VolumesSnapshotTestJSON-1743381734 None] Created volume successfully.
Apr 16 02:44:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Creating offline snapshot 587ee0ea-2be6-4a21-93ef-126634353a65 of volume ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:44:16 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff1c06-2a7b-49b8-8123-2c86b28977b5]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:16 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549
Apr 16 02:44:16 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:16 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" returned: 0 in 0.450s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:16 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 1G
Apr 16 02:44:16 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:17 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 1G" returned: 0 in 0.448s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:17 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65
Apr 16 02:44:17 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:17 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65" returned: 0 in 0.416s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:17 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 is being set with open permissions: ugo+rw
Apr 16 02:44:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:17 devstack sudo[90629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65
Apr 16 02:44:17 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:18 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65" returned: 0 in 0.395s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:18 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.info
Apr 16 02:44:18 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:18 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.info" returned: 0 in 0.413s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:18 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.info is being set with open permissions: ugo+rw
Apr 16 02:44:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:18 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.info
Apr 16 02:44:18 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:18 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.info" returned: 0 in 0.458s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f910275c-7e83-4764-9bbf-d02781c795dd tempest-VolumesSnapshotTestJSON-1743381734 None] Create snapshot completed successfully
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (a710e049-0409-4abf-9d4a-5a38dadfba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f73e91-322e-4421-bb19-7d3f1947a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f73e91-322e-4421-bb19-7d3f1947a003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-416220284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13914959-31d8-40a0-8713-fe8ca58ea8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f6ea8c287848409cf11e366557907d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=587ee0ea-2be6-4a21-93ef-126634353a65,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:20Z,use_quota=True,user_id='d5a2e01dc6f944ab9c0c3190c9fb4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb32c428-fc0f-4cba-8c0c-d93f90da7fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb32c428-fc0f-4cba-8c0c-d93f90da7fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ef12d-d26b-4bc7-89d2-2ff536657c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0ef12d-d26b-4bc7-89d2-2ff536657c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13914959-31d8-40a0-8713-fe8ca58ea8ee', 'volume_name': 'volume-13914959-31d8-40a0-8713-fe8ca58ea8ee', 'volume_size': 1, 'snapshot_id': '587ee0ea-2be6-4a21-93ef-126634353a65'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4a806c-850a-4522-b6fa-f861e0940b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4a806c-850a-4522-b6fa-f861e0940b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1189d832-c360-48a1-8eed-13489d5cf065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:19 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Volume 13914959-31d8-40a0-8713-fe8ca58ea8ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13914959-31d8-40a0-8713-fe8ca58ea8ee', 'volume_size': 1, 'snapshot_id': '587ee0ea-2be6-4a21-93ef-126634353a65'}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-587ee0ea-2be6-4a21-93ef-126634353a65-13914959-31d8-40a0-8713-fe8ca58ea8ee" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-587ee0ea-2be6-4a21-93ef-126634353a65-13914959-31d8-40a0-8713-fe8ca58ea8ee" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Creating volume 13914959-31d8-40a0-8713-fe8ca58ea8ee from snapshot 587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-13914959-31d8-40a0-8713-fe8ca58ea8ee" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-13914959-31d8-40a0-8713-fe8ca58ea8ee" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] snapshot: 587ee0ea-2be6-4a21-93ef-126634353a65, volume: 13914959-31d8-40a0-8713-fe8ca58ea8ee,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[59abac87-ac5c-4675-9c9c-398ea6cb5098]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:19 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65
Apr 16 02:44:19 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:20 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65" returned: 0 in 0.482s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f9dee-2013-41e4-9aa6-e99d90780664]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:20 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549
Apr 16 02:44:20 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:20 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" returned: 0 in 0.476s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:44:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:20 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee
Apr 16 02:44:20 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:22 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee" returned: 0 in 1.972s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eadee0-7d82-4166-be8a-eba82c75080f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:22 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549
Apr 16 02:44:22 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:23 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" returned: 0 in 0.581s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:44:23 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Converted 1024.00 MB image at 519.06 MB/s
Apr 16 02:44:23 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee is being set with open permissions: ugo+rw
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:23 devstack sudo[90665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee
Apr 16 02:44:23 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:23 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee" returned: 0 in 0.405s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-13914959-31d8-40a0-8713-fe8ca58ea8ee" released by "_copy_volume_from_snapshot" :: held 3.973s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-587ee0ea-2be6-4a21-93ef-126634353a65-13914959-31d8-40a0-8713-fe8ca58ea8ee" released by "_create_volume_from_snapshot" :: held 3.993s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1189d832-c360-48a1-8eed-13489d5cf065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13914959-31d8-40a0-8713-fe8ca58ea8ee', 'volume_size': 1, 'snapshot_id': '587ee0ea-2be6-4a21-93ef-126634353a65'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcdacd1-2a30-4c21-9c53-77dab920c3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:23 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Volume volume-13914959-31d8-40a0-8713-fe8ca58ea8ee (13914959-31d8-40a0-8713-fe8ca58ea8ee): created successfully
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcdacd1-2a30-4c21-9c53-77dab920c3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Flow 'volume_create_manager' (a710e049-0409-4abf-9d4a-5a38dadfba01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:23 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8e2625b8-7e59-49f3-b68b-4e5c6b47559c tempest-VolumesSnapshotTestJSON-1743381734 None] Created volume successfully.
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-13914959-31d8-40a0-8713-fe8ca58ea8ee-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-13914959-31d8-40a0-8713-fe8ca58ea8ee-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-13914959-31d8-40a0-8713-fe8ca58ea8ee" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-13914959-31d8-40a0-8713-fe8ca58ea8ee" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:24 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d08774-5de1-4219-ae11-032aae92443b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:24 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee
Apr 16 02:44:24 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:24 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee" returned: 0 in 0.513s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:24 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee
Apr 16 02:44:24 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:25 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-13914959-31d8-40a0-8713-fe8ca58ea8ee" returned: 0 in 0.426s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-13914959-31d8-40a0-8713-fe8ca58ea8ee" released by "delete_volume" :: held 0.961s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['54ccd444-8382-426e-9028-ec2e98a72c60', 'e6fb2809-8592-4e1f-acb9-3b2c89ace4c3', 'd545c7a4-f62d-404a-8e70-901b047f8fb7', 'f09f3ee2-85c5-48ca-adf7-ee38f2af4084'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:25 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:25 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:25 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.423s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Deleted volume successfully.
Apr 16 02:44:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-38f306ab-fe56-4d50-acca-a70d360de2a3 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-13914959-31d8-40a0-8713-fe8ca58ea8ee-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-587ee0ea-2be6-4a21-93ef-126634353a65-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-587ee0ea-2be6-4a21-93ef-126634353a65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-587ee0ea-2be6-4a21-93ef-126634353a65" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-587ee0ea-2be6-4a21-93ef-126634353a65" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Deleting offline snapshot 587ee0ea-2be6-4a21-93ef-126634353a65 of volume ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] snapshot_file for this snap is: volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[31353236-1c67-4143-b069-9f6a226fad78]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:26 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65
Apr 16 02:44:26 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:26 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0534e23-07b8-49aa-8230-61038ed4472c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:26 devstack sudo[90685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549
Apr 16 02:44:26 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:27 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" returned: 0 in 0.474s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:27 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65
Apr 16 02:44:27 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:27 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:27 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65
Apr 16 02:44:27 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:28 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549.587ee0ea-2be6-4a21-93ef-126634353a65" returned: 0 in 0.423s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-587ee0ea-2be6-4a21-93ef-126634353a65" released by "_delete_snapshot" :: held 1.880s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" released by "delete_snapshot" :: held 1.895s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['d4f2786d-2d5d-4e72-9896-00a09a147783', '281f627f-f01f-4fba-9f40-fa7d2111b6dc', '810aa512-f635-40ca-be8f-be8dd0f40266', 'c60ca42c-528e-46a9-92a6-8ea867b61bbf'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Delete snapshot completed successfully.
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c344703a-92cf-4b31-be6c-dc284ddf5330 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-587ee0ea-2be6-4a21-93ef-126634353a65-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-ed4158d4-3183-4e1a-acc1-6d11e2cd2549-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-ed4158d4-3183-4e1a-acc1-6d11e2cd2549-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[6148447d-fbb1-409d-a37c-bd17fead679d]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:28 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549
Apr 16 02:44:28 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:28 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:28 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549
Apr 16 02:44:28 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:29 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" returned: 0 in 0.417s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-ed4158d4-3183-4e1a-acc1-6d11e2cd2549" released by "delete_volume" :: held 0.924s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['f9363281-e206-4fe8-97b7-07bdc3eec5d3', 'd29d683f-a98b-4fa2-a971-de466169366a', 'c70a9c35-9451-418d-b30b-55494f43b698', 'b8a352ce-7ef5-49ff-928f-7c46d57198bc'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:29 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:29 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "cinder-quobyte-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94ab89-49ea-45b0-9888-ac497d1a661f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:29 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd
Apr 16 02:44:29 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:29 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:29 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Deleted volume successfully.
Apr 16 02:44:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6c3099ca-1598-4d51-9037-45032d8c1743 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-ed4158d4-3183-4e1a-acc1-6d11e2cd2549-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:30 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" returned: 0 in 0.505s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:30 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd
Apr 16 02:44:30 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:30 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" returned: 0 in 0.417s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-quobyte-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd" released by "delete_volume" :: held 0.959s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Created reservations ['8874527d-b3b2-45df-ad5f-4fdfbb145129', '9a4d0f4e-48be-4264-9c86-71e17e7e6503', '020b8a19-c983-4c5f-9a66-83b740da7907', '410ea684-9030-4c60-b0f4-05033baee520'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:30 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:30 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:31 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.491s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:31 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Deleted volume successfully.
Apr 16 02:44:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3f3c4a43-d536-4d98-8467-96fa1ca4afb5 tempest-VolumesSnapshotTestJSON-1743381734 None] Lock "cinder-9938c314-2f01-4852-b0a2-f9dbfa4eb8fd-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (f5a5ce27-5993-4f7d-a158-ced4e568937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b932dae8-dbca-4cc9-987f-fe2f4aa47898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b932dae8-dbca-4cc9-987f-fe2f4aa47898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982325817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a991e2c-8f9d-4445-9436-71b76377f9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:34Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1f9b68-d00f-4b39-ada5-9c39e800a1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1f9b68-d00f-4b39-ada5-9c39e800a1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a1a378-e254-4fa2-aaf7-dd3d10accfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a1a378-e254-4fa2-aaf7-dd3d10accfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a991e2c-8f9d-4445-9436-71b76377f9ba', 'volume_name': 'volume-2a991e2c-8f9d-4445-9436-71b76377f9ba', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70253de0-97a8-4d9e-94f7-8dc820ab9c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70253de0-97a8-4d9e-94f7-8dc820ab9c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68711a02-89a0-4d08-a756-1e6aacfc3996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:34 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume 2a991e2c-8f9d-4445-9436-71b76377f9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a991e2c-8f9d-4445-9436-71b76377f9ba', 'volume_size': 1}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1982325817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a991e2c-8f9d-4445-9436-71b76377f9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:34Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Creating volume 2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:34 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:44:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:34 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba 1073741824
Apr 16 02:44:34 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:35 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba 1073741824" returned: 0 in 0.529s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:35 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba
Apr 16 02:44:35 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:35 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68711a02-89a0-4d08-a756-1e6aacfc3996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a991e2c-8f9d-4445-9436-71b76377f9ba', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c7b033-9e93-4029-bccf-783bb7a9592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:35 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume volume-2a991e2c-8f9d-4445-9436-71b76377f9ba (2a991e2c-8f9d-4445-9436-71b76377f9ba): created successfully
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c7b033-9e93-4029-bccf-783bb7a9592d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (f5a5ce27-5993-4f7d-a158-ced4e568937a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-716753a8-7f8d-42a9-bb05-052cbe11bcb3 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created volume successfully.
Apr 16 02:44:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:36 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Creating offline snapshot 97152302-68fc-4234-894a-b0a6a8aa0abb of volume 2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:44:36 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b541abb0-ed6b-4c93-a2b3-51b2f4917109]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:36 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba
Apr 16 02:44:36 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:37 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba" returned: 0 in 0.509s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:37 devstack sudo[90739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb 1G
Apr 16 02:44:37 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:37 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb 1G" returned: 0 in 0.485s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a991e2c-8f9d-4445-9436-71b76377f9ba -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:37 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a991e2c-8f9d-4445-9436-71b76377f9ba -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb
Apr 16 02:44:37 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:38 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a991e2c-8f9d-4445-9436-71b76377f9ba -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb" returned: 0 in 0.428s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:38 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb is being set with open permissions: ugo+rw
Apr 16 02:44:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:38 devstack sudo[90749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb
Apr 16 02:44:38 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:38 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb" returned: 0 in 0.415s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:38 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.info
Apr 16 02:44:38 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:38 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.info" returned: 0 in 0.430s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:38 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.info is being set with open permissions: ugo+rw
Apr 16 02:44:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:38 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.info
Apr 16 02:44:38 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:39 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.info" returned: 0 in 0.423s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-674586ce-6da5-40fe-9835-6562ffab695c tempest-CreateVolumesFromSnapshotTest-46619721 None] Create snapshot completed successfully
Apr 16 02:44:39 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (ed1a9fde-a2b3-46d5-a8a9-4461c9b8de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6add154-58fa-4f7b-9fb3-8cae8e3a056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6add154-58fa-4f7b-9fb3-8cae8e3a056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417840443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12fa97ee-be99-4708-993a-497afa88ec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:40Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d544758d-5698-4492-9c1f-8497a7195106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d544758d-5698-4492-9c1f-8497a7195106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79fa8b-38b8-404d-b03f-bd23cf4a3990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b79fa8b-38b8-404d-b03f-bd23cf4a3990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12fa97ee-be99-4708-993a-497afa88ec2a', 'volume_name': 'volume-12fa97ee-be99-4708-993a-497afa88ec2a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5716282d-8135-440e-83af-cef4a29d4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5716282d-8135-440e-83af-cef4a29d4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15994a44-936c-4185-82a1-2af58b83c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume 12fa97ee-be99-4708-993a-497afa88ec2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12fa97ee-be99-4708-993a-497afa88ec2a', 'volume_size': 1}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-417840443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12fa97ee-be99-4708-993a-497afa88ec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:40Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Creating volume 12fa97ee-be99-4708-993a-497afa88ec2a {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:40 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:40 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a 1073741824
Apr 16 02:44:40 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (5e4e3865-307f-44f3-8e80-1b8e3af2d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c0a354-7a06-4c42-9275-2e781cb8ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c0a354-7a06-4c42-9275-2e781cb8ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1281257874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d273dd10-1bec-4ac0-875d-98ea219d36e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:40Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813831e6-0c6d-4b88-b2cf-d08bb7d86abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (813831e6-0c6d-4b88-b2cf-d08bb7d86abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb033b7-768c-4276-b54d-cd765bffe1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb033b7-768c-4276-b54d-cd765bffe1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd273dd10-1bec-4ac0-875d-98ea219d36e4', 'volume_name': 'volume-d273dd10-1bec-4ac0-875d-98ea219d36e4', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1491e3ca-ea6f-4482-bf9f-10ccd8dc63e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1491e3ca-ea6f-4482-bf9f-10ccd8dc63e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371432a2-cdb6-4daa-be87-10b313221d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume d273dd10-1bec-4ac0-875d-98ea219d36e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d273dd10-1bec-4ac0-875d-98ea219d36e4', 'volume_size': 1}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (4f3929c9-df06-4668-8473-bd63efd2068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0a55d4-078f-48f8-8d28-ca53d1893bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0a55d4-078f-48f8-8d28-ca53d1893bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1537924065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eacda8-ee9e-4fa6-a926-7133edf056dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:40Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101a0ac1-4a90-48d8-a34a-04567de749d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101a0ac1-4a90-48d8-a34a-04567de749d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ae9b34-82ec-49cc-9269-ab11ba9325e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ae9b34-82ec-49cc-9269-ab11ba9325e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93eacda8-ee9e-4fa6-a926-7133edf056dc', 'volume_name': 'volume-93eacda8-ee9e-4fa6-a926-7133edf056dc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdec8c11-c626-4587-96ac-0892d9cc1829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdec8c11-c626-4587-96ac-0892d9cc1829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d403aae6-31fc-48cd-9d8a-167e61b98b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume 93eacda8-ee9e-4fa6-a926-7133edf056dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93eacda8-ee9e-4fa6-a926-7133edf056dc', 'volume_size': 1}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:40 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a 1073741824" returned: 0 in 0.626s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (0510ea9c-4144-497e-890d-8e1b3fc0d891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7867c5f0-e6fb-4756-a3a4-9b326abe36ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7867c5f0-e6fb-4756-a3a4-9b326abe36ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736715193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b88336-1a89-4c68-a0dd-4b372406faa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:41Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0cac79-8c74-4428-a8dd-1cce6533fb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0cac79-8c74-4428-a8dd-1cce6533fb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37438d-0496-4e76-affc-e5c852dc9ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37438d-0496-4e76-affc-e5c852dc9ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b88336-1a89-4c68-a0dd-4b372406faa0', 'volume_name': 'volume-e6b88336-1a89-4c68-a0dd-4b372406faa0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8172279b-44fc-4a0f-a715-2ace96e0ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8172279b-44fc-4a0f-a715-2ace96e0ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba2af5f-7d00-468d-8d3d-28e2d0e9e2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume e6b88336-1a89-4c68-a0dd-4b372406faa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b88336-1a89-4c68-a0dd-4b372406faa0', 'volume_size': 1}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:40 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a
Apr 16 02:44:40 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (3c6436c3-3082-4249-951d-24284a98978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf5d020-77a9-4538-aa48-707beaa75746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf5d020-77a9-4538-aa48-707beaa75746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1119924686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14032967-6a29-4be7-946f-76fc7a82732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:41Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3297eff-d2c3-4cfa-9727-a76c2d19ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3297eff-d2c3-4cfa-9727-a76c2d19ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08af263-4198-42ff-88d8-3d1e92b8fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08af263-4198-42ff-88d8-3d1e92b8fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14032967-6a29-4be7-946f-76fc7a82732e', 'volume_name': 'volume-14032967-6a29-4be7-946f-76fc7a82732e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f888d8-434d-4efe-b884-cf7ef46e8415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f888d8-434d-4efe-b884-cf7ef46e8415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff456aea-e228-454e-b5f7-252204267ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume 14032967-6a29-4be7-946f-76fc7a82732e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14032967-6a29-4be7-946f-76fc7a82732e', 'volume_size': 1}
Apr 16 02:44:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:41 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1281257874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d273dd10-1bec-4ac0-875d-98ea219d36e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:40Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Creating volume d273dd10-1bec-4ac0-875d-98ea219d36e4 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:41 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15994a44-936c-4185-82a1-2af58b83c817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12fa97ee-be99-4708-993a-497afa88ec2a', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:41 devstack sudo[90766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4 1073741824
Apr 16 02:44:41 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c4ddec-ba21-4f4a-a12a-b74cb269ce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:41 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume volume-12fa97ee-be99-4708-993a-497afa88ec2a (12fa97ee-be99-4708-993a-497afa88ec2a): created successfully
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c4ddec-ba21-4f4a-a12a-b74cb269ce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (ed1a9fde-a2b3-46d5-a8a9-4461c9b8de63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:41 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-93efa8cd-ed63-44b9-9d47-f258477495f1 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created volume successfully.
Apr 16 02:44:41 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4 1073741824" returned: 0 in 0.522s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:41 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4
Apr 16 02:44:41 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:42 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4" returned: 0 in 0.448s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1537924065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eacda8-ee9e-4fa6-a926-7133edf056dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:40Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Creating volume 93eacda8-ee9e-4fa6-a926-7133edf056dc {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:42 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371432a2-cdb6-4daa-be87-10b313221d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d273dd10-1bec-4ac0-875d-98ea219d36e4', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fe9824-e29a-4347-8773-021d6aa251eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:42 devstack sudo[90774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc 1073741824
Apr 16 02:44:42 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:42 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume volume-d273dd10-1bec-4ac0-875d-98ea219d36e4 (d273dd10-1bec-4ac0-875d-98ea219d36e4): created successfully
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fe9824-e29a-4347-8773-021d6aa251eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (5e4e3865-307f-44f3-8e80-1b8e3af2d251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:42 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b32342dd-dccc-4a87-96f7-ae01455973fe tempest-CreateVolumesFromSnapshotTest-46619721 None] Created volume successfully.
Apr 16 02:44:42 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc 1073741824" returned: 0 in 0.520s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:42 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc
Apr 16 02:44:42 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:43 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc" returned: 0 in 0.431s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.461s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736715193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b88336-1a89-4c68-a0dd-4b372406faa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:41Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Creating volume e6b88336-1a89-4c68-a0dd-4b372406faa0 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:43 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d403aae6-31fc-48cd-9d8a-167e61b98b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93eacda8-ee9e-4fa6-a926-7133edf056dc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:43 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0 1073741824
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cbd6c7-8a8c-45ca-a090-5ebf4cf79525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:43 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:43 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume volume-93eacda8-ee9e-4fa6-a926-7133edf056dc (93eacda8-ee9e-4fa6-a926-7133edf056dc): created successfully
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cbd6c7-8a8c-45ca-a090-5ebf4cf79525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (4f3929c9-df06-4668-8473-bd63efd2068b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2ac62830-67c1-4bfb-91bf-28708c80ddd5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created volume successfully.
Apr 16 02:44:43 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0 1073741824" returned: 0 in 0.524s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:43 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0
Apr 16 02:44:43 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:44 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0" returned: 0 in 0.445s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.252s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1119924686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14032967-6a29-4be7-946f-76fc7a82732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='101efab53feb4511888b85388b2ecfc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:44:41Z,use_quota=True,user_id='b58f8feaf45f44e0a59a065f1208c613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Creating volume 14032967-6a29-4be7-946f-76fc7a82732e {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:44:44 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba2af5f-7d00-468d-8d3d-28e2d0e9e2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b88336-1a89-4c68-a0dd-4b372406faa0', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:44 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e 1073741824
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca025d5a-6626-47fd-9f1b-1b90904b97d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:44 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:44 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume volume-e6b88336-1a89-4c68-a0dd-4b372406faa0 (e6b88336-1a89-4c68-a0dd-4b372406faa0): created successfully
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca025d5a-6626-47fd-9f1b-1b90904b97d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (0510ea9c-4144-497e-890d-8e1b3fc0d891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:44 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c76a1d4e-9543-4bd3-97c4-ee33a347aa7c tempest-CreateVolumesFromSnapshotTest-46619721 None] Created volume successfully.
Apr 16 02:44:44 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e 1073741824" returned: 0 in 0.505s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:44 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e
Apr 16 02:44:44 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:45 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e" returned: 0 in 0.438s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff456aea-e228-454e-b5f7-252204267ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14032967-6a29-4be7-946f-76fc7a82732e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acab776-ddb0-4ff2-b6e2-997085c476b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:44:45 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Volume volume-14032967-6a29-4be7-946f-76fc7a82732e (14032967-6a29-4be7-946f-76fc7a82732e): created successfully
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acab776-ddb0-4ff2-b6e2-997085c476b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Flow 'volume_create_manager' (3c6436c3-3082-4249-951d-24284a98978a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:44:45 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1ba254fe-bae8-4406-8516-ee6c021491a5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created volume successfully.
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-14032967-6a29-4be7-946f-76fc7a82732e-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-14032967-6a29-4be7-946f-76fc7a82732e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-14032967-6a29-4be7-946f-76fc7a82732e" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-14032967-6a29-4be7-946f-76fc7a82732e" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3faef6-aca2-4d66-8f71-8db85250634a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:45 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e
Apr 16 02:44:45 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:45 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e" returned: 0 in 0.475s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:45 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e
Apr 16 02:44:45 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:46 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-14032967-6a29-4be7-946f-76fc7a82732e" returned: 0 in 0.407s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-14032967-6a29-4be7-946f-76fc7a82732e" released by "delete_volume" :: held 0.910s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created reservations ['abad428c-745e-4f73-937d-1b2f2ae8a7c3', '9301c571-52a7-4db0-b0e6-179f5a07c81f', '7a3fca2b-7d0c-4927-9162-5c357a96c711', '96942b50-54a3-4e11-b0f5-1a724dbf00c2'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:46 devstack sudo[90807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:46 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-e6b88336-1a89-4c68-a0dd-4b372406faa0-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-e6b88336-1a89-4c68-a0dd-4b372406faa0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-e6b88336-1a89-4c68-a0dd-4b372406faa0" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-e6b88336-1a89-4c68-a0dd-4b372406faa0" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c532ed7-b66a-4e05-a9b9-e7eace9fd7a2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:46 devstack sudo[90809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0
Apr 16 02:44:46 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:46 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.433s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:46 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Deleted volume successfully.
Apr 16 02:44:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4ced7e3b-4129-48b3-a131-395c002fd9f5 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-14032967-6a29-4be7-946f-76fc7a82732e-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:47 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0" returned: 0 in 0.478s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:47 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0
Apr 16 02:44:47 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:47 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e6b88336-1a89-4c68-a0dd-4b372406faa0" returned: 0 in 0.407s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-e6b88336-1a89-4c68-a0dd-4b372406faa0" released by "delete_volume" :: held 0.913s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created reservations ['2abb1142-5c0b-4bf0-8910-183cfdb1dfe8', 'be726a5e-b18c-484b-91d1-54f818b8d675', '3c361c41-bf64-4330-b187-a94ff25eab78', '1b715f04-fb0a-4c78-8ece-38bb17703d5d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:47 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:47 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-93eacda8-ee9e-4fa6-a926-7133edf056dc-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-93eacda8-ee9e-4fa6-a926-7133edf056dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-93eacda8-ee9e-4fa6-a926-7133edf056dc" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-93eacda8-ee9e-4fa6-a926-7133edf056dc" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1639ef-2e0d-4d82-9842-a17a0cb635aa]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:47 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc
Apr 16 02:44:47 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:47 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.444s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:47 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Deleted volume successfully.
Apr 16 02:44:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-bdc0602d-5f6a-4eda-b6b4-f0b5c5b241b8 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-e6b88336-1a89-4c68-a0dd-4b372406faa0-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:48 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:48 devstack sudo[90826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc
Apr 16 02:44:48 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:48 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-93eacda8-ee9e-4fa6-a926-7133edf056dc" returned: 0 in 0.418s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-93eacda8-ee9e-4fa6-a926-7133edf056dc" released by "delete_volume" :: held 0.931s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Created reservations ['cf253201-04c8-42e6-a4ac-455f120102c6', '52fa4719-1d1d-4fc7-9f86-27ac881b0da7', 'a6ba667a-4abc-4603-b3a4-4276a1c097a1', '336e9c05-8a7f-4808-bbe0-3fc59cf96cc5'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:48 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:48 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-d273dd10-1bec-4ac0-875d-98ea219d36e4-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-d273dd10-1bec-4ac0-875d-98ea219d36e4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-d273dd10-1bec-4ac0-875d-98ea219d36e4" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-d273dd10-1bec-4ac0-875d-98ea219d36e4" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f95c6fd-6a39-45b3-9118-437e403a29e6]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:48 devstack sudo[90831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4
Apr 16 02:44:48 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:49 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.446s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:49 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Deleted volume successfully.
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-9fbfe4a9-c9ba-4764-a5af-f864f2d2221b tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-93eacda8-ee9e-4fa6-a926-7133edf056dc-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:49 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4" returned: 0 in 0.493s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:49 devstack sudo[90837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4
Apr 16 02:44:49 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:49 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d273dd10-1bec-4ac0-875d-98ea219d36e4" returned: 0 in 0.430s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-d273dd10-1bec-4ac0-875d-98ea219d36e4" released by "delete_volume" :: held 0.946s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created reservations ['0f60da42-5b4a-4487-82fc-7117726c9df9', '0198881f-b9cd-4661-baa1-671050c2357c', '4dc7fc8d-4549-4375-a18f-520af38d030f', '1ea7fc80-0462-454f-b4b7-14c7e90034ec'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:49 devstack sudo[90840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:49 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-12fa97ee-be99-4708-993a-497afa88ec2a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-12fa97ee-be99-4708-993a-497afa88ec2a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-12fa97ee-be99-4708-993a-497afa88ec2a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-12fa97ee-be99-4708-993a-497afa88ec2a" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c40f8-fd66-4087-ad5d-a5b18afa40c3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:49 devstack sudo[90842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a
Apr 16 02:44:49 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:50 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.421s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:50 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Deleted volume successfully.
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33491391-048d-4898-a95c-7a65d6052557 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-d273dd10-1bec-4ac0-875d-98ea219d36e4-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:50 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a" returned: 0 in 0.489s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:50 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a
Apr 16 02:44:50 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:50 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-12fa97ee-be99-4708-993a-497afa88ec2a" returned: 0 in 0.451s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-12fa97ee-be99-4708-993a-497afa88ec2a" released by "delete_volume" :: held 0.962s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Created reservations ['51fb5b97-e1ec-4f9e-9abc-32facb4e5d2f', '6f7c436e-c578-4299-9086-73f04d82e500', 'f79042e3-e487-45d3-a278-b00ca00a85a4', '10654e79-29bc-438a-b1bc-c61ff11f325d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:50 devstack sudo[90851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:50 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-97152302-68fc-4234-894a-b0a6a8aa0abb-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-97152302-68fc-4234-894a-b0a6a8aa0abb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-2a991e2c-8f9d-4445-9436-71b76377f9ba" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-2a991e2c-8f9d-4445-9436-71b76377f9ba" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-97152302-68fc-4234-894a-b0a6a8aa0abb" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-97152302-68fc-4234-894a-b0a6a8aa0abb" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Deleting offline snapshot 97152302-68fc-4234-894a-b0a6a8aa0abb of volume 2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] snapshot_file for this snap is: volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8211bcb-56df-4d93-a54e-b0de3f2cc52c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:51 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb
Apr 16 02:44:51 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:51 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.426s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Deleted volume successfully.
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-999c659f-e1ac-4957-9b4c-25b2c72b036d tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-12fa97ee-be99-4708-993a-497afa88ec2a-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:51 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a991e2c-8f9d-4445-9436-71b76377f9ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b9a9e8-62a2-4e76-b9d1-7315c7b5df67]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:51 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba
Apr 16 02:44:51 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:52 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba" returned: 0 in 0.464s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:52 devstack sudo[90870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb
Apr 16 02:44:52 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:52 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:52 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb
Apr 16 02:44:52 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:52 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba.97152302-68fc-4234-894a-b0a6a8aa0abb" returned: 0 in 0.436s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-97152302-68fc-4234-894a-b0a6a8aa0abb" released by "_delete_snapshot" :: held 1.919s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-2a991e2c-8f9d-4445-9436-71b76377f9ba" released by "delete_snapshot" :: held 1.930s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:52 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Created reservations ['675ad39f-0169-4103-886f-6830148d2814', '175d106a-b789-46e9-928b-c8e4901fc54f', 'e788d381-12cf-4e2c-a9e0-fcea5fee3441', '214c8539-309a-41db-b653-6c8b88e1ac72'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Delete snapshot completed successfully.
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-2f46a1be-10ff-488f-8efa-e6607797cec4 tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-97152302-68fc-4234-894a-b0a6a8aa0abb-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-2a991e2c-8f9d-4445-9436-71b76377f9ba-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-2a991e2c-8f9d-4445-9436-71b76377f9ba-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "cinder-quobyte-2a991e2c-8f9d-4445-9436-71b76377f9ba" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-2a991e2c-8f9d-4445-9436-71b76377f9ba" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8c3c80-2209-4e39-90c6-a5bf8bece980]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:53 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba
Apr 16 02:44:53 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:53 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:53 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba
Apr 16 02:44:53 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:54 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-2a991e2c-8f9d-4445-9436-71b76377f9ba" returned: 0 in 0.415s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-quobyte-2a991e2c-8f9d-4445-9436-71b76377f9ba" released by "delete_volume" :: held 0.927s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Created reservations ['84f997c3-632a-45bb-a39e-8b3bded4c569', 'bd48ec54-e8ce-4acf-8c1c-f94d834a9556', 'ac54ca7d-66f5-420a-8ae1-2f4b56a8d5da', '3748ddcc-5dae-4c17-9fed-62cb7f87a14c'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:54 devstack sudo[90886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:54 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:44:54 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.491s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:44:54 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Deleted volume successfully.
Apr 16 02:44:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-372872c4-4658-4343-be7c-57607e366daa tempest-CreateVolumesFromSnapshotTest-46619721 None] Lock "cinder-2a991e2c-8f9d-4445-9436-71b76377f9ba-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:44:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:44:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:44:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:44:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:44:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:44:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:44:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:44:59 devstack sudo[90891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:44:59 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:00 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.514s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:04 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=106,cinder:UPDATE=138,cinder:INSERT=36,cinder:DELETE=11 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:45:04 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:UPDATE=130,cinder:DELETE=12,cinder:SELECT=93,cinder:INSERT=30 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Flow 'volume_create_manager' (a0c724a8-3955-4d89-8c36-b52e75172fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d7c9b7-fcc0-4fee-9ff7-b9374e55ab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d7c9b7-fcc0-4fee-9ff7-b9374e55ab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-901545545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb1334c-f872-4a57-aac8-cd185d9ff180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b9e92d25b94234a4a59f377df7d6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:09Z,use_quota=True,user_id='c8b766bd579449af9c8d1a49077d89e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce3a744-9291-495f-8c50-844250a149f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce3a744-9291-495f-8c50-844250a149f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c808e9b9-749c-4ef5-bbc6-d5a679c0b2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c808e9b9-749c-4ef5-bbc6-d5a679c0b2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fb1334c-f872-4a57-aac8-cd185d9ff180', 'volume_name': 'volume-5fb1334c-f872-4a57-aac8-cd185d9ff180', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dc77cb-bec8-4b15-8f73-c3440c30c3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99dc77cb-bec8-4b15-8f73-c3440c30c3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6461f79-e14d-4b69-a29d-e6f4f9e5acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:08 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Volume 5fb1334c-f872-4a57-aac8-cd185d9ff180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fb1334c-f872-4a57-aac8-cd185d9ff180', 'volume_size': 1}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-901545545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb1334c-f872-4a57-aac8-cd185d9ff180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b9e92d25b94234a4a59f377df7d6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:09Z,use_quota=True,user_id='c8b766bd579449af9c8d1a49077d89e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Creating volume 5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:08 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:08 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 1073741824
Apr 16 02:45:08 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:09 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 1073741824" returned: 0 in 0.549s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:09 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180
Apr 16 02:45:09 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:09 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180" returned: 0 in 0.437s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6461f79-e14d-4b69-a29d-e6f4f9e5acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb1334c-f872-4a57-aac8-cd185d9ff180', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c734899-9847-404d-ac62-4945b9bebfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:09 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Volume volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 (5fb1334c-f872-4a57-aac8-cd185d9ff180): created successfully
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c734899-9847-404d-ac62-4945b9bebfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Flow 'volume_create_manager' (a0c724a8-3955-4d89-8c36-b52e75172fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:09 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-fd5d02d3-8377-4603-86cb-bf647fce4b27 tempest-SnapshotDependencyTests-1903076939 None] Created volume successfully.
Apr 16 02:45:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:10 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Creating offline snapshot aad30ddb-21a1-44b6-83be-9e39542ce6c2 of volume 5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:45:10 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f163b7e-60a4-4450-838a-3ad1788d8ea4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:10 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180
Apr 16 02:45:10 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:11 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180" returned: 0 in 0.453s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:11 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 1G
Apr 16 02:45:11 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:11 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 1G" returned: 0 in 0.454s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:11 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2
Apr 16 02:45:11 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:12 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2" returned: 0 in 0.415s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:12 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 is being set with open permissions: ugo+rw
Apr 16 02:45:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:12 devstack sudo[90953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2
Apr 16 02:45:12 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:12 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2" returned: 0 in 0.388s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:12 devstack sudo[90956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.info
Apr 16 02:45:12 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:12 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.info" returned: 0 in 0.399s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:12 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.info is being set with open permissions: ugo+rw
Apr 16 02:45:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:13 devstack sudo[90959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.info
Apr 16 02:45:13 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:13 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.info" returned: 0 in 0.417s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:13 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3dd73fdc-95ef-46fd-8cae-c3f327cfe13d tempest-SnapshotDependencyTests-1903076939 None] Create snapshot completed successfully
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Flow 'volume_create_manager' (2a0d8774-8509-4763-80d1-31225b5bbc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd97592e-337f-47ac-9407-167b437a0432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd97592e-337f-47ac-9407-167b437a0432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772f3970-a7a8-4af1-a343-895ceed60ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b9e92d25b94234a4a59f377df7d6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aad30ddb-21a1-44b6-83be-9e39542ce6c2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:14Z,use_quota=True,user_id='c8b766bd579449af9c8d1a49077d89e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679686ba-488d-45e8-8f46-015958379ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679686ba-488d-45e8-8f46-015958379ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146b2b74-c830-47ce-8364-b319fb7e4cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146b2b74-c830-47ce-8364-b319fb7e4cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '772f3970-a7a8-4af1-a343-895ceed60ee1', 'volume_name': 'volume-772f3970-a7a8-4af1-a343-895ceed60ee1', 'volume_size': 1, 'snapshot_id': 'aad30ddb-21a1-44b6-83be-9e39542ce6c2'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c8f02e-7af7-4706-8912-69408f9569da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c8f02e-7af7-4706-8912-69408f9569da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a55798-a446-43e9-a702-aa74eea70ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Volume 772f3970-a7a8-4af1-a343-895ceed60ee1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-772f3970-a7a8-4af1-a343-895ceed60ee1', 'volume_size': 1, 'snapshot_id': 'aad30ddb-21a1-44b6-83be-9e39542ce6c2'}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-quobyte-aad30ddb-21a1-44b6-83be-9e39542ce6c2-772f3970-a7a8-4af1-a343-895ceed60ee1" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-aad30ddb-21a1-44b6-83be-9e39542ce6c2-772f3970-a7a8-4af1-a343-895ceed60ee1" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Creating volume 772f3970-a7a8-4af1-a343-895ceed60ee1 from snapshot aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-quobyte-772f3970-a7a8-4af1-a343-895ceed60ee1" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-772f3970-a7a8-4af1-a343-895ceed60ee1" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] snapshot: aad30ddb-21a1-44b6-83be-9e39542ce6c2, volume: 772f3970-a7a8-4af1-a343-895ceed60ee1,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e688d2-c9e2-4588-8c50-7c71b626d7b7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:14 devstack sudo[90962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2
Apr 16 02:45:14 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:14 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2" returned: 0 in 0.452s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb1334c-f872-4a57-aac8-cd185d9ff180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[77457b67-3d90-4158-987b-2fbedfba00c7]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:14 devstack sudo[90968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180
Apr 16 02:45:14 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:15 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180" returned: 0 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:15 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:45:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:15 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1
Apr 16 02:45:15 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:17 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1" returned: 0 in 2.104s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3bb422-d488-436a-abd3-22c574b20d6d]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:17 devstack sudo[90986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180
Apr 16 02:45:17 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:17 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180" returned: 0 in 0.609s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:17 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:45:17 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Converted 1024.00 MB image at 486.43 MB/s
Apr 16 02:45:17 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1 is being set with open permissions: ugo+rw
Apr 16 02:45:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:18 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1
Apr 16 02:45:18 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:18 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1" returned: 0 in 0.413s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-772f3970-a7a8-4af1-a343-895ceed60ee1" released by "_copy_volume_from_snapshot" :: held 4.100s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-aad30ddb-21a1-44b6-83be-9e39542ce6c2-772f3970-a7a8-4af1-a343-895ceed60ee1" released by "_create_volume_from_snapshot" :: held 4.116s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.124s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a55798-a446-43e9-a702-aa74eea70ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772f3970-a7a8-4af1-a343-895ceed60ee1', 'volume_size': 1, 'snapshot_id': 'aad30ddb-21a1-44b6-83be-9e39542ce6c2'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80730932-5c93-4ae7-aa8e-e51e7c498447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:18 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Volume volume-772f3970-a7a8-4af1-a343-895ceed60ee1 (772f3970-a7a8-4af1-a343-895ceed60ee1): created successfully
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80730932-5c93-4ae7-aa8e-e51e7c498447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Flow 'volume_create_manager' (2a0d8774-8509-4763-80d1-31225b5bbc23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a7511e61-0403-424a-be43-e350199b2821 tempest-SnapshotDependencyTests-1903076939 None] Created volume successfully.
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-aad30ddb-21a1-44b6-83be-9e39542ce6c2-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-aad30ddb-21a1-44b6-83be-9e39542ce6c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-quobyte-5fb1334c-f872-4a57-aac8-cd185d9ff180" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-5fb1334c-f872-4a57-aac8-cd185d9ff180" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-quobyte-aad30ddb-21a1-44b6-83be-9e39542ce6c2" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-aad30ddb-21a1-44b6-83be-9e39542ce6c2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Deleting offline snapshot aad30ddb-21a1-44b6-83be-9e39542ce6c2 of volume 5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] snapshot_file for this snap is: volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[327afc99-6f82-447d-b4f4-2e72341ab78b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:19 devstack sudo[90994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2
Apr 16 02:45:19 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:20 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2" returned: 0 in 0.460s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:20 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fb1334c-f872-4a57-aac8-cd185d9ff180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:45:20 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[917d953c-893e-4140-a504-976505070883]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:20 devstack sudo[90999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180
Apr 16 02:45:20 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:20 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:20 devstack sudo[91006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2
Apr 16 02:45:20 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:21 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2" returned: 0 in 0.487s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:21 devstack sudo[91011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2
Apr 16 02:45:21 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:21 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180.aad30ddb-21a1-44b6-83be-9e39542ce6c2" returned: 0 in 0.421s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-aad30ddb-21a1-44b6-83be-9e39542ce6c2" released by "_delete_snapshot" :: held 1.893s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-5fb1334c-f872-4a57-aac8-cd185d9ff180" released by "delete_snapshot" :: held 1.902s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Created reservations ['6bd93b10-0a3f-4c2e-8271-bfbbf27ae19f', '6a7499c8-dfde-4db2-a62b-564f7ed0b1ff', 'b390b79c-e87a-4c37-98bf-fdb67d187bb9', '52c3beb7-c19e-4761-9685-c840d34f79c8'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Delete snapshot completed successfully.
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a2352560-c80d-48c8-bec5-2afca8d0c1e7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-aad30ddb-21a1-44b6-83be-9e39542ce6c2-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-5fb1334c-f872-4a57-aac8-cd185d9ff180-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-5fb1334c-f872-4a57-aac8-cd185d9ff180-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-quobyte-5fb1334c-f872-4a57-aac8-cd185d9ff180" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-5fb1334c-f872-4a57-aac8-cd185d9ff180" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c4d643-c782-4b52-a5d1-6d275019e6c4]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:21 devstack sudo[91014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180
Apr 16 02:45:21 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:22 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180" returned: 0 in 0.454s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:22 devstack sudo[91019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180
Apr 16 02:45:22 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:22 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5fb1334c-f872-4a57-aac8-cd185d9ff180" returned: 0 in 0.423s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-5fb1334c-f872-4a57-aac8-cd185d9ff180" released by "delete_volume" :: held 0.911s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Created reservations ['0f1560d3-c56d-4985-88b6-cf87b8a7e745', '6fb03c42-d552-4b6d-8e26-2f7f3fbd7720', 'b1f654b8-ee07-4325-aee5-4f1710bc856e', 'fed20a8a-5942-4334-a80a-73dc84ae971b'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:22 devstack sudo[91022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:22 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-772f3970-a7a8-4af1-a343-895ceed60ee1-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-772f3970-a7a8-4af1-a343-895ceed60ee1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "cinder-quobyte-772f3970-a7a8-4af1-a343-895ceed60ee1" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-772f3970-a7a8-4af1-a343-895ceed60ee1" acquired by "delete_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69f935d-6ea3-4f43-bafe-dc0f9d0e49ac]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:23 devstack sudo[91024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1
Apr 16 02:45:23 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:23 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.418s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:23 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Deleted volume successfully.
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-03987987-ff2e-46c3-b5fa-ab57a0b2e102 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-5fb1334c-f872-4a57-aac8-cd185d9ff180-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:23 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1" returned: 0 in 0.508s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:23 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1
Apr 16 02:45:23 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:23 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-772f3970-a7a8-4af1-a343-895ceed60ee1" returned: 0 in 0.411s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-quobyte-772f3970-a7a8-4af1-a343-895ceed60ee1" released by "delete_volume" :: held 0.965s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Created reservations ['332619a2-cff6-48d6-b9fb-2a349f5ade2a', 'ec2dc8b7-1e14-428e-9a61-3fa812480664', 'c8ff35c5-8f43-4de3-b1d5-1608b25caefd', 'cc6e7105-0695-49f1-9f38-18c50edc1b5e'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:23 devstack sudo[91033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:23 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:24 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.432s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:24 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:24 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Deleted volume successfully.
Apr 16 02:45:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e597df0e-490e-422b-950c-9c18f9b62ee7 tempest-SnapshotDependencyTests-1903076939 None] Lock "cinder-772f3970-a7a8-4af1-a343-895ceed60ee1-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:33 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=27,cinder:UPDATE=34,cinder:INSERT=11,cinder:DELETE=2 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:45:34 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:UPDATE=22,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=3 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (add86097-cdd1-4d88-bcdf-2b8d08f18db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f17d40-2327-450a-acc0-486571e510d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f17d40-2327-450a-acc0-486571e510d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-908067070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af50e45f-acd2-4156-8142-f4beb107d3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842155ac11a74e94a00d410bf6186d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:36Z,use_quota=True,user_id='7a2b53c997134211b24ac3bf93ec2be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9991e2a7-1e66-4958-aabd-b52a29a6db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9991e2a7-1e66-4958-aabd-b52a29a6db1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195f945e-8f12-4fb5-99e6-7454a26470df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195f945e-8f12-4fb5-99e6-7454a26470df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af50e45f-acd2-4156-8142-f4beb107d3a9', 'volume_name': 'volume-af50e45f-acd2-4156-8142-f4beb107d3a9', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6719bc14-f8d0-44d7-9af5-8864bb336237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6719bc14-f8d0-44d7-9af5-8864bb336237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fc006e-749d-405c-b11a-6a3bac127e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:35 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Volume af50e45f-acd2-4156-8142-f4beb107d3a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af50e45f-acd2-4156-8142-f4beb107d3a9', 'volume_size': 1}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-908067070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af50e45f-acd2-4156-8142-f4beb107d3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842155ac11a74e94a00d410bf6186d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:36Z,use_quota=True,user_id='7a2b53c997134211b24ac3bf93ec2be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Creating volume af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:35 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:35 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 1073741824
Apr 16 02:45:35 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (7fe84e00-844e-4ef8-bea7-615cd2530a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eba12f-c9b3-4113-9f8a-808ecd2e274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eba12f-c9b3-4113-9f8a-808ecd2e274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592854695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ae20c3-9798-49d7-af64-5d81e007a441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:36Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bbe1b6-6d47-469e-af3c-3d885a6552e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bbe1b6-6d47-469e-af3c-3d885a6552e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034be609-461a-473d-910f-dd0ed62840eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034be609-461a-473d-910f-dd0ed62840eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ae20c3-9798-49d7-af64-5d81e007a441', 'volume_name': 'volume-95ae20c3-9798-49d7-af64-5d81e007a441', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e56fea-8857-438f-99ac-6d79b1928dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e56fea-8857-438f-99ac-6d79b1928dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be096706-63fb-419d-b440-918b63d1e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume 95ae20c3-9798-49d7-af64-5d81e007a441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ae20c3-9798-49d7-af64-5d81e007a441', 'volume_size': 1}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (297882dd-80cc-4746-9cfd-85389e8a3f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3992af-6cb5-4869-bd96-2a31a31f9a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3992af-6cb5-4869-bd96-2a31a31f9a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709787422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf565ca0-413c-4036-804a-6bcaa1cd6229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:36Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ac5caf-b9c1-4fe5-b7e5-9fd019c17e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ac5caf-b9c1-4fe5-b7e5-9fd019c17e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901b9dbf-2e66-4e76-84c8-8151d1a7512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901b9dbf-2e66-4e76-84c8-8151d1a7512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf565ca0-413c-4036-804a-6bcaa1cd6229', 'volume_name': 'volume-bf565ca0-413c-4036-804a-6bcaa1cd6229', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92fd836-25b7-444b-83ee-b02a96231d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92fd836-25b7-444b-83ee-b02a96231d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274fe88c-54d4-43a8-907c-b1376db4ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Volume bf565ca0-413c-4036-804a-6bcaa1cd6229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf565ca0-413c-4036-804a-6bcaa1cd6229', 'volume_size': 1}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (92e48d0d-4e93-4031-9677-076bbf74d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbebbd2e-850f-411b-8b6f-8675f425e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbebbd2e-850f-411b-8b6f-8675f425e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1149395467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0799d02-ec67-4ab3-96a9-d11c468c05cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1c289d-bbbf-414d-a8cc-876e0aa33b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1c289d-bbbf-414d-a8cc-876e0aa33b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f23eb93-5cdb-44fc-9b13-2cea43da6d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f23eb93-5cdb-44fc-9b13-2cea43da6d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0799d02-ec67-4ab3-96a9-d11c468c05cd', 'volume_name': 'volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e3bb35-f581-4cda-8329-eea558823ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e3bb35-f581-4cda-8329-eea558823ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea93462-7dff-4933-af39-51d14fa056b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Volume d0799d02-ec67-4ab3-96a9-d11c468c05cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd', 'volume_size': 1}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:36 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 1073741824" returned: 0 in 0.753s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:36 devstack sudo[91089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9
Apr 16 02:45:36 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (5a6760f5-9dc0-4e6c-89e3-5fd52ddb175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852edf64-3891-4f3a-9079-a8230a70083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852edf64-3891-4f3a-9079-a8230a70083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306425514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed92dab-c6c7-4754-ad27-4ed5e91a9951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b65981-9c9a-46ab-b71c-22f8262ee0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b65981-9c9a-46ab-b71c-22f8262ee0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7745c12e-af22-4476-b8ff-48b53479a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7745c12e-af22-4476-b8ff-48b53479a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed92dab-c6c7-4754-ad27-4ed5e91a9951', 'volume_name': 'volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4282afdf-4cf5-4e20-a47f-c19c6ff7683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4282afdf-4cf5-4e20-a47f-c19c6ff7683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e93004-d691-42c4-8a43-4f85f750cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:36 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Volume 1ed92dab-c6c7-4754-ad27-4ed5e91a9951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951', 'volume_size': 1}
Apr 16 02:45:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (1c87e298-96fc-4552-8a5a-0bca025fcf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e319f9-5f51-4df4-b139-4d9c3470512c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e319f9-5f51-4df4-b139-4d9c3470512c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483487831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72f2aa3-ffc2-4357-a854-8278e0ed04cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f283976-cf60-4a62-8dc8-eacaff77db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f283976-cf60-4a62-8dc8-eacaff77db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87509c39-5217-4afb-86ad-1774deb75624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87509c39-5217-4afb-86ad-1774deb75624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a72f2aa3-ffc2-4357-a854-8278e0ed04cc', 'volume_name': 'volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96da58ac-4219-43f4-8862-e7834c48a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96da58ac-4219-43f4-8862-e7834c48a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b74b46-8558-41ec-b298-28740cc11695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Volume a72f2aa3-ffc2-4357-a854-8278e0ed04cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc', 'volume_size': 1}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:37 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9" returned: 0 in 0.526s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1592854695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ae20c3-9798-49d7-af64-5d81e007a441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:36Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Creating volume 95ae20c3-9798-49d7-af64-5d81e007a441 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:37 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73fc006e-749d-405c-b11a-6a3bac127e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af50e45f-acd2-4156-8142-f4beb107d3a9', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33832e7a-7470-4d79-bef1-e1a120643fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441 1073741824
Apr 16 02:45:37 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:37 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Volume volume-af50e45f-acd2-4156-8142-f4beb107d3a9 (af50e45f-acd2-4156-8142-f4beb107d3a9): created successfully
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33832e7a-7470-4d79-bef1-e1a120643fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (add86097-cdd1-4d88-bcdf-2b8d08f18db2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (b3779927-3fe5-4d94-b5a7-4549f3ff8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d96688-9db0-428f-a53a-0e30f6af3c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d96688-9db0-428f-a53a-0e30f6af3c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926577608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec75286-0ddc-44a5-910d-f64d2b986588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a303a17c-7a80-4da6-b9c2-949331a7cb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a303a17c-7a80-4da6-b9c2-949331a7cb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bc2bda-a693-4a40-bc1e-1bb0516949b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bc2bda-a693-4a40-bc1e-1bb0516949b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec75286-0ddc-44a5-910d-f64d2b986588', 'volume_name': 'volume-5ec75286-0ddc-44a5-910d-f64d2b986588', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d495518-9ed7-47ea-ae0a-51b919b663ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d495518-9ed7-47ea-ae0a-51b919b663ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b46f13f-436d-4d10-a341-6a886c9cb38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:37 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Volume 5ec75286-0ddc-44a5-910d-f64d2b986588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec75286-0ddc-44a5-910d-f64d2b986588', 'volume_size': 1}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:37 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3cf673ab-6e95-4525-88ae-5685beef2971 tempest-VolumeDependencyTests-456622533 None] Created volume successfully.
Apr 16 02:45:37 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441 1073741824" returned: 0 in 0.567s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:37 devstack sudo[91097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441
Apr 16 02:45:37 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:38 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441" returned: 0 in 0.473s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.981s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-709787422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf565ca0-413c-4036-804a-6bcaa1cd6229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:36Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Creating volume bf565ca0-413c-4036-804a-6bcaa1cd6229 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:38 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be096706-63fb-419d-b440-918b63d1e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ae20c3-9798-49d7-af64-5d81e007a441', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b14275-e851-4087-b1d4-69e15abacda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:38 devstack sudo[91100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229 1073741824
Apr 16 02:45:38 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:38 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume volume-95ae20c3-9798-49d7-af64-5d81e007a441 (95ae20c3-9798-49d7-af64-5d81e007a441): created successfully
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b14275-e851-4087-b1d4-69e15abacda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (7fe84e00-844e-4ef8-bea7-615cd2530a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c5f87c3e-31d7-40db-91b5-3e424b940d1c tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created volume successfully.
Apr 16 02:45:38 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229 1073741824" returned: 0 in 0.561s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:38 devstack sudo[91105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229
Apr 16 02:45:38 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:39 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229" returned: 0 in 0.522s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.785s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1149395467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0799d02-ec67-4ab3-96a9-d11c468c05cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Creating volume d0799d02-ec67-4ab3-96a9-d11c468c05cd {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:39 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274fe88c-54d4-43a8-907c-b1376db4ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf565ca0-413c-4036-804a-6bcaa1cd6229', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c62843-78ea-431c-a968-2de668f1515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack sudo[91108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd 1073741824
Apr 16 02:45:39 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:39 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Volume volume-bf565ca0-413c-4036-804a-6bcaa1cd6229 (bf565ca0-413c-4036-804a-6bcaa1cd6229): created successfully
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c62843-78ea-431c-a968-2de668f1515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (297882dd-80cc-4746-9cfd-85389e8a3f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-2b607fb9-6388-4cde-95a1-fef84c71dfdf tempest-CreateVolumesFromImageTest-1392295075 None] Created volume successfully.
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (3921cb71-8b62-4d17-b6e3-d3428435d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f538daaf-0587-482c-b6cd-5b945736f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f538daaf-0587-482c-b6cd-5b945736f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817896492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40804847-9111-4f38-8f24-0e0febcbf8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d7576-f243-4ae1-84cc-a54c8bcf528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a2d7576-f243-4ae1-84cc-a54c8bcf528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e96f95-7068-4d89-8760-41b1fa25259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e96f95-7068-4d89-8760-41b1fa25259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40804847-9111-4f38-8f24-0e0febcbf8e1', 'volume_name': 'volume-40804847-9111-4f38-8f24-0e0febcbf8e1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61080d91-4680-4553-8826-8b12b0cfea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61080d91-4680-4553-8826-8b12b0cfea8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7694d5af-5480-44b4-803c-6c1fcfdfec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume 40804847-9111-4f38-8f24-0e0febcbf8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40804847-9111-4f38-8f24-0e0febcbf8e1', 'volume_size': 1}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (5c03460f-72cc-4f47-b9dc-0f2606737b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfeb620-ddcb-4bd0-80de-afbd1b04693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfeb620-ddcb-4bd0-80de-afbd1b04693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825210184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490b4b8-2410-4e91-913b-641346d5e735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78abb31-64cf-443c-950d-0d4430e0082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78abb31-64cf-443c-950d-0d4430e0082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3c70f7-8b4d-468e-8158-a017dded6518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3c70f7-8b4d-468e-8158-a017dded6518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e490b4b8-2410-4e91-913b-641346d5e735', 'volume_name': 'volume-e490b4b8-2410-4e91-913b-641346d5e735', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea463c5-ed13-458c-a5b5-4344d07511e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea463c5-ed13-458c-a5b5-4344d07511e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8113876f-611e-4d75-a100-97409d33ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:39 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume e490b4b8-2410-4e91-913b-641346d5e735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e490b4b8-2410-4e91-913b-641346d5e735', 'volume_size': 1}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:39 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (a79cdaf2-7b6e-41dc-b20e-2a098cf178b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8275a4-2659-411a-ab98-44526e5841b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8275a4-2659-411a-ab98-44526e5841b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1036276413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b4b54e-1184-4063-8926-e1d05420ae2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f791c8c5-5b71-4aae-b46f-4e9915f443a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f791c8c5-5b71-4aae-b46f-4e9915f443a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6a6a63-6a1c-4546-aa76-c8872cb6c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6a6a63-6a1c-4546-aa76-c8872cb6c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b4b54e-1184-4063-8926-e1d05420ae2d', 'volume_name': 'volume-a6b4b54e-1184-4063-8926-e1d05420ae2d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76f4f4a-58bd-41d2-a963-1a9c40978794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76f4f4a-58bd-41d2-a963-1a9c40978794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c129bf5-f7bb-4dde-a632-9b1f9f4e9a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume a6b4b54e-1184-4063-8926-e1d05420ae2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b4b54e-1184-4063-8926-e1d05420ae2d', 'volume_size': 1}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:40 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd 1073741824" returned: 0 in 0.717s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:40 devstack sudo[91113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd
Apr 16 02:45:40 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (f03dd3cc-8f8e-4474-94ee-e871e4b13d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90de1d37-e487-4bbd-9b5b-5ddc5e15db46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90de1d37-e487-4bbd-9b5b-5ddc5e15db46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915480643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24fc036-9060-4d3b-8aa2-1b799653e747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4f85a2-7758-476d-92ee-54a49124ecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4f85a2-7758-476d-92ee-54a49124ecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797f88d6-39ae-4667-a271-dd40c145671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797f88d6-39ae-4667-a271-dd40c145671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24fc036-9060-4d3b-8aa2-1b799653e747', 'volume_name': 'volume-b24fc036-9060-4d3b-8aa2-1b799653e747', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851ac43e-6a9c-4648-81c3-83f1f68abf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851ac43e-6a9c-4648-81c3-83f1f68abf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0770934-4b0e-46f9-a299-1c519e584097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume b24fc036-9060-4d3b-8aa2-1b799653e747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24fc036-9060-4d3b-8aa2-1b799653e747', 'volume_size': 1}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (46814b77-7fef-4c0c-abbb-18ab83905c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c862a21e-0a6d-495c-abb5-ae63047ad44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c862a21e-0a6d-495c-abb5-ae63047ad44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044101849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdf153e-7f83-4c29-9fa7-4d77db83969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2af0ebf-285f-4d2f-b0aa-1e1143e9b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2af0ebf-285f-4d2f-b0aa-1e1143e9b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c0174c-f489-43b9-b52e-21d5f1916607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c0174c-f489-43b9-b52e-21d5f1916607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fdf153e-7f83-4c29-9fa7-4d77db83969e', 'volume_name': 'volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2868cbf-f851-42eb-a41b-8e2f80b5a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2868cbf-f851-42eb-a41b-8e2f80b5a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48dbfac-c3cb-4eb2-ada5-d731c8ad8750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume 0fdf153e-7f83-4c29-9fa7-4d77db83969e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e', 'volume_size': 1}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:40 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd" returned: 0 in 0.592s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.841s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306425514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed92dab-c6c7-4754-ad27-4ed5e91a9951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Creating volume 1ed92dab-c6c7-4754-ad27-4ed5e91a9951 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:40 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea93462-7dff-4933-af39-51d14fa056b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8421644a-4a6e-48e6-b7e1-606f33ccd3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:40 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951 1073741824
Apr 16 02:45:40 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:40 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Volume volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd (d0799d02-ec67-4ab3-96a9-d11c468c05cd): created successfully
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8421644a-4a6e-48e6-b7e1-606f33ccd3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:40 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (92e48d0d-4e93-4031-9677-076bbf74d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:40 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f82a438d-4b9b-4fe1-912c-714a01753ab5 tempest-CreateVolumesFromImageTest-1392295075 None] Created volume successfully.
Apr 16 02:45:41 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951 1073741824" returned: 0 in 0.591s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:41 devstack sudo[91121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951
Apr 16 02:45:41 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:41 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951" returned: 0 in 0.520s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.799s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483487831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72f2aa3-ffc2-4357-a854-8278e0ed04cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Creating volume a72f2aa3-ffc2-4357-a854-8278e0ed04cc {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:41 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e93004-d691-42c4-8a43-4f85f750cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a862e38f-e9f3-490d-beeb-6d5148f25103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:41 devstack sudo[91124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc 1073741824
Apr 16 02:45:41 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:41 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Volume volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951 (1ed92dab-c6c7-4754-ad27-4ed5e91a9951): created successfully
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a862e38f-e9f3-490d-beeb-6d5148f25103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:41 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (5a6760f5-9dc0-4e6c-89e3-5fd52ddb175b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:41 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d4c5d05d-1fb4-45ea-9f48-5999e05c7f12 tempest-CreateVolumesFromImageTest-1392295075 None] Created volume successfully.
Apr 16 02:45:42 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc 1073741824" returned: 0 in 0.545s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:42 devstack sudo[91129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc
Apr 16 02:45:42 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:42 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc" returned: 0 in 0.460s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.580s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926577608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec75286-0ddc-44a5-910d-f64d2b986588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334d90cfa3754773922ed9f8760a0d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:37Z,use_quota=True,user_id='076b8bfd1f734b7c815a7217e42df265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Creating volume 5ec75286-0ddc-44a5-910d-f64d2b986588 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:42 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b74b46-8558-41ec-b298-28740cc11695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:42 devstack sudo[91132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588 1073741824
Apr 16 02:45:42 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529580eb-e0b6-465e-bb9b-2bc2feb50b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:42 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Volume volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc (a72f2aa3-ffc2-4357-a854-8278e0ed04cc): created successfully
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529580eb-e0b6-465e-bb9b-2bc2feb50b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:42 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (1c87e298-96fc-4552-8a5a-0bca025fcf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:43 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-63cebbb5-b9b8-487b-8baa-e1bd4ee64aac tempest-CreateVolumesFromImageTest-1392295075 None] Created volume successfully.
Apr 16 02:45:43 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588 1073741824" returned: 0 in 0.575s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:43 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:43 devstack sudo[91137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588
Apr 16 02:45:43 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:44 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588" returned: 0 in 0.478s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.885s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b46f13f-436d-4d10-a341-6a886c9cb38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec75286-0ddc-44a5-910d-f64d2b986588', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46737ce4-edc1-4681-a446-332f7bd5d43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Creating offline snapshot 5f5268fb-4a7e-49c0-990b-abc9ee494a57 of volume af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:45:44 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Volume volume-5ec75286-0ddc-44a5-910d-f64d2b986588 (5ec75286-0ddc-44a5-910d-f64d2b986588): created successfully
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46737ce4-edc1-4681-a446-332f7bd5d43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Flow 'volume_create_manager' (b3779927-3fe5-4d94-b5a7-4549f3ff8603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d81cae9-58bd-4341-b385-3cd6b9a57f35]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:44 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a60d04a5-48bc-4532-b26a-d96ad24e1942 tempest-CreateVolumesFromImageTest-1392295075 None] Created volume successfully.
Apr 16 02:45:44 devstack sudo[91140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9
Apr 16 02:45:44 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:44 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9" returned: 0 in 0.515s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:44 devstack sudo[91145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 1G
Apr 16 02:45:44 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-5ec75286-0ddc-44a5-910d-f64d2b986588-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-5ec75286-0ddc-44a5-910d-f64d2b986588-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-quobyte-5ec75286-0ddc-44a5-910d-f64d2b986588" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-5ec75286-0ddc-44a5-910d-f64d2b986588" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab75279-4361-438a-8cf3-d88e0c0b4992]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:44 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:45 devstack sudo[91148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588
Apr 16 02:45:45 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:45 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 1G" returned: 0 in 0.552s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af50e45f-acd2-4156-8142-f4beb107d3a9 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:45 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af50e45f-acd2-4156-8142-f4beb107d3a9 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57
Apr 16 02:45:45 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:45 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588" returned: 0 in 0.551s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:45 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588
Apr 16 02:45:45 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:45 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af50e45f-acd2-4156-8142-f4beb107d3a9 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57" returned: 0 in 0.560s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:45 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 is being set with open permissions: ugo+rw
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:45 devstack sudo[91163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57
Apr 16 02:45:45 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:45 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-5ec75286-0ddc-44a5-910d-f64d2b986588" returned: 0 in 0.407s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-5ec75286-0ddc-44a5-910d-f64d2b986588" released by "delete_volume" :: held 0.985s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:45 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Created reservations ['68df14f4-3a7e-41f9-b26a-8c382b523945', 'a1a2474a-5099-4d7e-b8d0-7eddd188c09c', '43154bb5-07a1-430d-a3ff-ce0291ed1a92', 'c06b03fa-f567-472e-af88-7b526aa59bf7'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:46 devstack sudo[91166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:46 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:46 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57" returned: 0 in 0.495s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:46 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.info
Apr 16 02:45:46 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:46 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.509s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:46 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Deleted volume successfully.
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e463d31f-8231-453f-bd2d-ccc52117fd6b tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-5ec75286-0ddc-44a5-910d-f64d2b986588-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:46 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.info" returned: 0 in 0.479s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:46 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.info is being set with open permissions: ugo+rw
Apr 16 02:45:46 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:46 devstack sudo[91173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.info
Apr 16 02:45:46 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-a72f2aa3-ffc2-4357-a854-8278e0ed04cc-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-a72f2aa3-ffc2-4357-a854-8278e0ed04cc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:47 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.info" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.194s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.572s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817896492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40804847-9111-4f38-8f24-0e0febcbf8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Creating volume 40804847-9111-4f38-8f24-0e0febcbf8e1 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:47 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:47 devstack sudo[91176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1 1073741824
Apr 16 02:45:47 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-quobyte-a72f2aa3-ffc2-4357-a854-8278e0ed04cc" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:47 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e1d99f72-d310-4be6-bd30-92f49f2c52a2 tempest-VolumeDependencyTests-456622533 None] Create snapshot completed successfully
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-a72f2aa3-ffc2-4357-a854-8278e0ed04cc" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e792a10-8558-4450-8f38-10cacb22d965]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:47 devstack sudo[91178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc
Apr 16 02:45:47 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (a66b7cf9-6a45-4166-9cf2-f37bcbf4bd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b062b8e-f017-4721-883d-8e1ad3a64962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b062b8e-f017-4721-883d-8e1ad3a64962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1200332443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d15e29-5ea7-41c2-b98f-4c5765e18a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842155ac11a74e94a00d410bf6186d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f5268fb-4a7e-49c0-990b-abc9ee494a57,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:48Z,use_quota=True,user_id='7a2b53c997134211b24ac3bf93ec2be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b182c3e0-97a4-48fc-9c2f-f887f310e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b182c3e0-97a4-48fc-9c2f-f887f310e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d6af76-13bb-4b04-b9c8-534f40f0bd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d6af76-13bb-4b04-b9c8-534f40f0bd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23d15e29-5ea7-41c2-b98f-4c5765e18a4f', 'volume_name': 'volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f', 'volume_size': 1, 'snapshot_id': '5f5268fb-4a7e-49c0-990b-abc9ee494a57'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddee988-35da-4c7f-8605-2257f93c910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddee988-35da-4c7f-8605-2257f93c910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb67d744-0433-4140-b5b0-7ee39957e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:47 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Volume 23d15e29-5ea7-41c2-b98f-4c5765e18a4f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f', 'volume_size': 1, 'snapshot_id': '5f5268fb-4a7e-49c0-990b-abc9ee494a57'}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:47 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1 1073741824" returned: 0 in 0.641s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:47 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc" returned: 0 in 0.607s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:47 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:47 devstack sudo[91186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1
Apr 16 02:45:47 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:47 devstack sudo[91188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc
Apr 16 02:45:47 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:48 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1" returned: 0 in 0.438s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.507s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825210184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490b4b8-2410-4e91-913b-641346d5e735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Creating volume e490b4b8-2410-4e91-913b-641346d5e735 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:48 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7694d5af-5480-44b4-803c-6c1fcfdfec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40804847-9111-4f38-8f24-0e0febcbf8e1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582728ff-38b0-4600-918d-fc6c93e943f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:48 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume volume-40804847-9111-4f38-8f24-0e0febcbf8e1 (40804847-9111-4f38-8f24-0e0febcbf8e1): created successfully
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582728ff-38b0-4600-918d-fc6c93e943f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:48 devstack sudo[91192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735 1073741824
Apr 16 02:45:48 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (3921cb71-8b62-4d17-b6e3-d3428435d71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:48 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a6e11d3d-6add-4a5e-8d4a-8cbb37f53945 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created volume successfully.
Apr 16 02:45:48 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a72f2aa3-ffc2-4357-a854-8278e0ed04cc" returned: 0 in 0.498s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-a72f2aa3-ffc2-4357-a854-8278e0ed04cc" released by "delete_volume" :: held 1.132s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Created reservations ['223c5f95-034e-4797-aac2-dfa26bc9b3f7', '676079dd-a402-4f89-9a68-99a0a2111e71', '8d8b3a55-170a-4857-9945-bd4991b7b838', '023b9440-2aff-4c91-98ab-30e57123e658'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:48 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:48 devstack sudo[91194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:48 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:48 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735 1073741824" returned: 0 in 0.642s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:49 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.537s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:49 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Deleted volume successfully.
Apr 16 02:45:49 devstack sudo[91200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735
Apr 16 02:45:49 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-8cc93c41-5242-44db-aa84-c3ad99e8565d tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-a72f2aa3-ffc2-4357-a854-8278e0ed04cc-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-1ed92dab-c6c7-4754-ad27-4ed5e91a9951-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-1ed92dab-c6c7-4754-ad27-4ed5e91a9951-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-quobyte-1ed92dab-c6c7-4754-ad27-4ed5e91a9951" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-1ed92dab-c6c7-4754-ad27-4ed5e91a9951" acquired by "delete_volume" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f28025-8ab5-4ceb-9be9-749b164342c9]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:49 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735" returned: 0 in 0.510s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:49 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951
Apr 16 02:45:49 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.493s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1036276413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b4b54e-1184-4063-8926-e1d05420ae2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Creating volume a6b4b54e-1184-4063-8926-e1d05420ae2d {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:49 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8113876f-611e-4d75-a100-97409d33ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e490b4b8-2410-4e91-913b-641346d5e735', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:49 devstack sudo[91205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d 1073741824
Apr 16 02:45:49 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67472c8f-e758-47e9-97ae-b09f5786015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:49 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume volume-e490b4b8-2410-4e91-913b-641346d5e735 (e490b4b8-2410-4e91-913b-641346d5e735): created successfully
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67472c8f-e758-47e9-97ae-b09f5786015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:49 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (5c03460f-72cc-4f47-b9dc-0f2606737b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:49 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3449fe09-062d-49a4-bea4-d3154c5c886f tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created volume successfully.
Apr 16 02:45:50 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951" returned: 0 in 0.671s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:50 devstack sudo[91213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951
Apr 16 02:45:50 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:50 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d 1073741824" returned: 0 in 0.604s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:50 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d
Apr 16 02:45:50 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:50 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-1ed92dab-c6c7-4754-ad27-4ed5e91a9951" returned: 0 in 0.557s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:50 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-1ed92dab-c6c7-4754-ad27-4ed5e91a9951" released by "delete_volume" :: held 1.283s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d" returned: 0 in 0.509s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.405s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915480643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24fc036-9060-4d3b-8aa2-1b799653e747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Creating volume b24fc036-9060-4d3b-8aa2-1b799653e747 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:50 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c129bf5-f7bb-4dde-a632-9b1f9f4e9a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b4b54e-1184-4063-8926-e1d05420ae2d', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c34e61-5070-47cd-9764-94e6e4dfad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:50 devstack sudo[91219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747 1073741824
Apr 16 02:45:50 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:50 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume volume-a6b4b54e-1184-4063-8926-e1d05420ae2d (a6b4b54e-1184-4063-8926-e1d05420ae2d): created successfully
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c34e61-5070-47cd-9764-94e6e4dfad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (a79cdaf2-7b6e-41dc-b20e-2a098cf178b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:50 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-119fe68b-c83e-47d1-8991-ca3ac9783473 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created volume successfully.
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Created reservations ['e52bca27-8220-4cc3-9f2b-998e671d5d5f', '5b5170e6-e1a5-4795-aa37-73b52023a521', 'ab792780-a84c-41ae-b8fd-a15f66443f42', '86beca35-38f0-4025-b37f-d19df1a6a70e'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:50 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:50 devstack sudo[91221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:50 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:51 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747 1073741824" returned: 0 in 0.583s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:51 devstack sudo[91233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747
Apr 16 02:45:51 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:51 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.565s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Deleted volume successfully.
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a0bab130-877e-4ae3-921a-2da255b36dde tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-1ed92dab-c6c7-4754-ad27-4ed5e91a9951-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-d0799d02-ec67-4ab3-96a9-d11c468c05cd-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-d0799d02-ec67-4ab3-96a9-d11c468c05cd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-quobyte-d0799d02-ec67-4ab3-96a9-d11c468c05cd" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-d0799d02-ec67-4ab3-96a9-d11c468c05cd" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192ded0-c2d7-4b6e-8820-6ff5bbd89f52]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:51 devstack sudo[91235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd
Apr 16 02:45:51 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:51 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747" returned: 0 in 0.477s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.219s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044101849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdf153e-7f83-4c29-9fa7-4d77db83969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1347e211104b4632a882cc9252cfaf81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:40Z,use_quota=True,user_id='36df455f1a2f4545a05834bf0e8fc283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Creating volume 0fdf153e-7f83-4c29-9fa7-4d77db83969e {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:51 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0770934-4b0e-46f9-a299-1c519e584097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24fc036-9060-4d3b-8aa2-1b799653e747', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:51 devstack sudo[91238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e 1073741824
Apr 16 02:45:51 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a621c55-7b31-407b-bd5c-eb17bb40c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:51 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume volume-b24fc036-9060-4d3b-8aa2-1b799653e747 (b24fc036-9060-4d3b-8aa2-1b799653e747): created successfully
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a621c55-7b31-407b-bd5c-eb17bb40c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:51 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (f03dd3cc-8f8e-4474-94ee-e871e4b13d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:51 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-5fef00eb-ab50-490c-89c4-94c2297ae656 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created volume successfully.
Apr 16 02:45:52 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd" returned: 0 in 0.597s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:52 devstack sudo[91243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd
Apr 16 02:45:52 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:52 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e 1073741824" returned: 0 in 0.599s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:52 devstack sudo[91248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e
Apr 16 02:45:52 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:52 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d0799d02-ec67-4ab3-96a9-d11c468c05cd" returned: 0 in 0.527s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-d0799d02-ec67-4ab3-96a9-d11c468c05cd" released by "delete_volume" :: held 1.149s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Created reservations ['99a5a78e-d513-4fce-a995-80f04bf25189', '5c0c13a6-2678-4474-8622-c5c2175d6af0', '48c3f55a-cdbb-41c8-88ae-09712cf56ba6', '8b11b09d-ece2-417a-8571-a9d406c2f4ae'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:52 devstack sudo[91251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:52 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:52 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e" returned: 0 in 0.487s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.087s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:52 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-5f5268fb-4a7e-49c0-990b-abc9ee494a57-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48dbfac-c3cb-4eb2-ada5-d731c8ad8750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ae091c-c6cd-41e3-ad9b-c601f0050b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-5f5268fb-4a7e-49c0-990b-abc9ee494a57-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" acquired by "_create_volume_from_snapshot" :: waited 0.087s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Creating volume 23d15e29-5ea7-41c2-b98f-4c5765e18a4f from snapshot 5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:53 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Volume volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e (0fdf153e-7f83-4c29-9fa7-4d77db83969e): created successfully
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ae091c-c6cd-41e3-ad9b-c601f0050b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Flow 'volume_create_manager' (46814b77-7fef-4c0c-abbb-18ab83905c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] snapshot: 5f5268fb-4a7e-49c0-990b-abc9ee494a57, volume: 23d15e29-5ea7-41c2-b98f-4c5765e18a4f,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3683335-766e-4984-a8f8-ea75da1aa0bb]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-00d82e83-7e7a-442c-ae0b-2bb3fc2a7dbc tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created volume successfully.
Apr 16 02:45:53 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57
Apr 16 02:45:53 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:53 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.555s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:53 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Deleted volume successfully.
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a11b5a22-c698-469e-8acd-1ed0f585efed tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-d0799d02-ec67-4ab3-96a9-d11c468c05cd-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-0fdf153e-7f83-4c29-9fa7-4d77db83969e-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-0fdf153e-7f83-4c29-9fa7-4d77db83969e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-quobyte-0fdf153e-7f83-4c29-9fa7-4d77db83969e" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-0fdf153e-7f83-4c29-9fa7-4d77db83969e" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a773468-6d26-4698-8477-2c5db60e4251]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:53 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e
Apr 16 02:45:53 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:53 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57" returned: 0 in 0.603s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af50e45f-acd2-4156-8142-f4beb107d3a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce32480-9e52-4262-b639-970079bf8fc6]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-bf565ca0-413c-4036-804a-6bcaa1cd6229-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-bf565ca0-413c-4036-804a-6bcaa1cd6229-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "cinder-quobyte-bf565ca0-413c-4036-804a-6bcaa1cd6229" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:53 devstack sudo[91262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9
Apr 16 02:45:53 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-bf565ca0-413c-4036-804a-6bcaa1cd6229" acquired by "delete_volume" :: waited 0.006s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[61840651-4585-47ac-9a6e-a1b2e18770e8]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:53 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:53 devstack sudo[91264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229
Apr 16 02:45:53 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:54 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e" returned: 0 in 0.569s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:54 devstack sudo[91269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e
Apr 16 02:45:54 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Flow 'volume_create_manager' (aacd13d9-59b4-4539-9095-90d021a7f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a3b59d-c9c5-4dc7-9e98-6c9bb895429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a3b59d-c9c5-4dc7-9e98-6c9bb895429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-823216192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12606d1-7222-44f9-a6ec-45dccdec19a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7987af2c384fb9bc0991c6b8cf48b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:54Z,use_quota=True,user_id='db8312b50c5e45b1abb5413b94ac8087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9539b4be-0d3b-41f0-8209-bfc853c6c471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9539b4be-0d3b-41f0-8209-bfc853c6c471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c8eada-55df-4268-a4df-42b93d418bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c8eada-55df-4268-a4df-42b93d418bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f12606d1-7222-44f9-a6ec-45dccdec19a1', 'volume_name': 'volume-f12606d1-7222-44f9-a6ec-45dccdec19a1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3badf-df34-4f72-86ee-e004cdc00137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3badf-df34-4f72-86ee-e004cdc00137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe8c8b6-97e2-478c-86ac-7c8661401fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:54 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Volume f12606d1-7222-44f9-a6ec-45dccdec19a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f12606d1-7222-44f9-a6ec-45dccdec19a1', 'volume_size': 1}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:54 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9" returned: 0 in 0.560s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:54 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f
Apr 16 02:45:54 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:54 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229" returned: 0 in 0.555s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:54 devstack sudo[91279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229
Apr 16 02:45:54 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:54 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-0fdf153e-7f83-4c29-9fa7-4d77db83969e" returned: 0 in 0.501s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-0fdf153e-7f83-4c29-9fa7-4d77db83969e" released by "delete_volume" :: held 1.104s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created reservations ['0b8124fc-f0c5-4f5d-a228-ad503ad09705', 'ddd11dc6-9467-435d-949c-746ac4561a43', 'c6f45750-93c4-4656-ac87-a26cd00702cd', '8912a45f-47c1-4114-8109-8fc53211193f'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:54 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:54 devstack sudo[91289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:54 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:55 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-bf565ca0-413c-4036-804a-6bcaa1cd6229" returned: 0 in 0.683s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-quobyte-bf565ca0-413c-4036-804a-6bcaa1cd6229" released by "delete_volume" :: held 1.269s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Created reservations ['3c4dc052-0748-47b6-96e9-75cb0dc4934d', '27fe2f89-4255-4d5b-8f43-57b47041e6be', '42c7c973-c78b-4bfb-a4b3-59a88b2fd054', 'd69a6338-a719-422e-bb90-e324364b9ec2'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:55 devstack sudo[91296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:55 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-b24fc036-9060-4d3b-8aa2-1b799653e747-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:55 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-b24fc036-9060-4d3b-8aa2-1b799653e747-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-quobyte-b24fc036-9060-4d3b-8aa2-1b799653e747" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-b24fc036-9060-4d3b-8aa2-1b799653e747" acquired by "delete_volume" :: waited 0.053s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2ca917-52f2-4597-a37c-ce0832ee473c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:56 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.858s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:56 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Deleted volume successfully.
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-452d0a40-5737-4ada-a0c4-b20a67d986c3 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-0fdf153e-7f83-4c29-9fa7-4d77db83969e-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:56 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747
Apr 16 02:45:56 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:56 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.343s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:56 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Deleted volume successfully.
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-353c5721-c739-4226-a27f-5dedc2aae21a tempest-CreateVolumesFromImageTest-1392295075 None] Lock "cinder-bf565ca0-413c-4036-804a-6bcaa1cd6229-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:56 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" returned: 0 in 2.598s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29c3860-02ab-495d-becd-7ef785cd421f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:56 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:56 devstack sudo[91303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9
Apr 16 02:45:56 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:57 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747" returned: 0 in 0.997s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:57 devstack sudo[91308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747
Apr 16 02:45:57 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:57 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9" returned: 0 in 0.696s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9, size 1024.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:45:57 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Converted 1024.00 MB image at 393.95 MB/s
Apr 16 02:45:57 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f is being set with open permissions: ugo+rw
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:57 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f
Apr 16 02:45:57 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:57 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-b24fc036-9060-4d3b-8aa2-1b799653e747" returned: 0 in 0.485s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-b24fc036-9060-4d3b-8aa2-1b799653e747" released by "delete_volume" :: held 1.560s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created reservations ['98d0f730-b578-41e9-a685-6a6548e76c58', 'd99c3cb1-08df-4da2-9908-fb794dfd292a', 'b4842f83-698d-495d-972c-f4d6c23388c5', '359b82bd-7837-4ce9-b3e9-3799cd4a583d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:57 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:57 devstack sudo[91316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:57 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-a6b4b54e-1184-4063-8926-e1d05420ae2d-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-a6b4b54e-1184-4063-8926-e1d05420ae2d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:58 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" returned: 0 in 0.540s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" released by "_copy_volume_from_snapshot" :: held 5.069s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-quobyte-a6b4b54e-1184-4063-8926-e1d05420ae2d" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-5f5268fb-4a7e-49c0-990b-abc9ee494a57-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" released by "_create_volume_from_snapshot" :: held 5.129s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.219s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.893s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-823216192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f12606d1-7222-44f9-a6ec-45dccdec19a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7987af2c384fb9bc0991c6b8cf48b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:54Z,use_quota=True,user_id='db8312b50c5e45b1abb5413b94ac8087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Creating volume f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:58 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:58 devstack sudo[91319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 1073741824
Apr 16 02:45:58 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-a6b4b54e-1184-4063-8926-e1d05420ae2d" acquired by "delete_volume" :: waited 0.050s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb67d744-0433-4140-b5b0-7ee39957e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f', 'volume_size': 1, 'snapshot_id': '5f5268fb-4a7e-49c0-990b-abc9ee494a57'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479e0467-b3d0-4e8c-a9a1-4a03114be751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18e1d16-72c1-488a-8ed9-b3c3c5d30d67]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:58 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Volume volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f (23d15e29-5ea7-41c2-b98f-4c5765e18a4f): created successfully
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479e0467-b3d0-4e8c-a9a1-4a03114be751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (a66b7cf9-6a45-4166-9cf2-f37bcbf4bd29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-055cf9bc-e522-47c5-b594-d6fd38d1cf96 tempest-VolumeDependencyTests-456622533 None] Created volume successfully.
Apr 16 02:45:58 devstack sudo[91321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d
Apr 16 02:45:58 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:58 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.525s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:58 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Deleted volume successfully.
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80e8e9b2-5bee-4c11-8a4f-468bae87c53e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-b24fc036-9060-4d3b-8aa2-1b799653e747-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (864c681b-5bb0-4232-862b-c5b70a3254a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4903085d-01fa-46f6-ab8e-cd7918dea965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4903085d-01fa-46f6-ab8e-cd7918dea965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848748871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f6e75a-5214-4e74-a164-6b0a7f919689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:58Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d134adb7-7016-4fd7-8281-bff464b4bd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d134adb7-7016-4fd7-8281-bff464b4bd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c72d48f-af72-4bad-a05f-6e1deab82aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c72d48f-af72-4bad-a05f-6e1deab82aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f6e75a-5214-4e74-a164-6b0a7f919689', 'volume_name': 'volume-10f6e75a-5214-4e74-a164-6b0a7f919689', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948ce9f5-bfc9-47fa-8cf0-310de3c9637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948ce9f5-bfc9-47fa-8cf0-310de3c9637b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bcffc7-dc1b-4bda-9b15-e44a8ad9a930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:58 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume 10f6e75a-5214-4e74-a164-6b0a7f919689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f6e75a-5214-4e74-a164-6b0a7f919689', 'volume_size': 1}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:58 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 1073741824" returned: 0 in 0.543s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-5f5268fb-4a7e-49c0-990b-abc9ee494a57-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:58 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d" returned: 0 in 0.603s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-5f5268fb-4a7e-49c0-990b-abc9ee494a57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-af50e45f-acd2-4156-8142-f4beb107d3a9" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:58 devstack sudo[91330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d
Apr 16 02:45:58 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-af50e45f-acd2-4156-8142-f4beb107d3a9" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-5f5268fb-4a7e-49c0-990b-abc9ee494a57" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-5f5268fb-4a7e-49c0-990b-abc9ee494a57" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Deleting offline snapshot 5f5268fb-4a7e-49c0-990b-abc9ee494a57 of volume af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] snapshot_file for this snap is: volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cf2133-32d1-4a55-9c3e-2444b821fe61]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:58 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:58 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1
Apr 16 02:45:58 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:58 devstack sudo[91332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57
Apr 16 02:45:58 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:59 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-a6b4b54e-1184-4063-8926-e1d05420ae2d" returned: 0 in 0.430s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-a6b4b54e-1184-4063-8926-e1d05420ae2d" released by "delete_volume" :: held 1.064s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created reservations ['825f3bde-3b86-4529-9f78-eef0de1e846b', '81755199-fd65-40d3-801b-fdc7f7349765', 'e1c97a52-e106-4cb6-9a3f-5dd8c443bc3a', '9a33ef5e-9ca5-43d0-b61f-b8f452664ccf'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:45:59 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1848748871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f6e75a-5214-4e74-a164-6b0a7f919689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:45:58Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Creating volume 10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:45:59 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe8c8b6-97e2-478c-86ac-7c8661401fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f12606d1-7222-44f9-a6ec-45dccdec19a1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:59 devstack sudo[91341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 1073741824
Apr 16 02:45:59 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaec151-f421-4f7c-8dcb-401056004c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:45:59 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Volume volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 (f12606d1-7222-44f9-a6ec-45dccdec19a1): created successfully
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddaec151-f421-4f7c-8dcb-401056004c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Flow 'volume_create_manager' (aacd13d9-59b4-4539-9095-90d021a7f865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:45:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e24d7f75-a604-461d-9fca-81667b38aafb tempest-SnapshotDependencyTests-1678228329 None] Created volume successfully.
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:59 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57" returned: 0 in 0.567s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af50e45f-acd2-4156-8142-f4beb107d3a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:45:59 devstack sudo[91343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:59 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ec8cb1-0b94-47df-bbe9-5292e13601d5]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:59 devstack sudo[91345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9
Apr 16 02:45:59 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:59 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.483s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:45:59 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Deleted volume successfully.
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-baa19187-2939-4b0c-b341-89daea26d31e tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-a6b4b54e-1184-4063-8926-e1d05420ae2d-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_service.periodic_task [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83205) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:45:59 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root
Apr 16 02:45:59 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 1073741824" returned: 0 in 0.622s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:45:59 devstack sudo[91354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:45:59 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:00 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9" returned: 0 in 0.545s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:00 devstack sudo[91356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689
Apr 16 02:46:00 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:00 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57
Apr 16 02:46:00 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-e490b4b8-2410-4e91-913b-641346d5e735-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-e490b4b8-2410-4e91-913b-641346d5e735-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-quobyte-e490b4b8-2410-4e91-913b-641346d5e735" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-e490b4b8-2410-4e91-913b-641346d5e735" acquired by "delete_volume" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca5005-1760-4474-88ab-e28bc8973b92]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:00 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6e630bbb-ad09-49dd-92b0-4acff64f35d7 None None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:00 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735
Apr 16 02:46:00 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:00 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.633s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bcffc7-dc1b-4bda-9b15-e44a8ad9a930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f6e75a-5214-4e74-a164-6b0a7f919689', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f1fb3b-6f9e-414e-82e5-0260d84a86af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Creating offline snapshot b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 of volume f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:46:00 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume volume-10f6e75a-5214-4e74-a164-6b0a7f919689 (10f6e75a-5214-4e74-a164-6b0a7f919689): created successfully
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f1fb3b-6f9e-414e-82e5-0260d84a86af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (864c681b-5bb0-4232-862b-c5b70a3254a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dd2d63-6dca-467d-ac53-b02cabb42fdb]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:00 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:00 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-46767fc9-cafb-4c8c-bfb9-27794bb799be tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created volume successfully.
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57" returned: 0 in 0.581s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:00 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57
Apr 16 02:46:00 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:00 devstack sudo[91367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1
Apr 16 02:46:00 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:00 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735" returned: 0 in 0.563s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:00 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:00 devstack sudo[91374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735
Apr 16 02:46:00 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:01 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1" returned: 0 in 0.491s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:01 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9.5f5268fb-4a7e-49c0-990b-abc9ee494a57" returned: 0 in 0.481s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:01 devstack sudo[91380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 1G
Apr 16 02:46:01 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-5f5268fb-4a7e-49c0-990b-abc9ee494a57" released by "_delete_snapshot" :: held 2.245s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-af50e45f-acd2-4156-8142-f4beb107d3a9" released by "delete_snapshot" :: held 2.257s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Created reservations ['006a7662-ae6e-45cd-8f52-0669caa54481', '4a8c07f1-7d30-4e74-9353-7c9ffb625daf', 'ddf243c6-82fa-4b45-bc38-0faa31afbd60', '0b342bd5-01d2-4667-89ee-9eadcdf1f3af'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:01 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Delete snapshot completed successfully.
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-4b5dc32d-7a83-495b-94b0-51a17d3fe026 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-5f5268fb-4a7e-49c0-990b-abc9ee494a57-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:01 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e490b4b8-2410-4e91-913b-641346d5e735" returned: 0 in 0.446s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-e490b4b8-2410-4e91-913b-641346d5e735" released by "delete_volume" :: held 1.050s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created reservations ['25fbcc8a-4c6f-4a4b-bc13-23f9868f5f0e', '11944221-e59d-4607-916e-3c07f31deccd', '7ff6e859-8cdb-440e-8de6-878f39ced44e', '8af3777a-d6fe-425a-9b47-20722c7678e1'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:01 devstack sudo[91385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:01 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:01 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 1G" returned: 0 in 0.527s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:01 devstack sudo[91388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2
Apr 16 02:46:01 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:01 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.422s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:01 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Deleted volume successfully.
Apr 16 02:46:01 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-89696e5c-6530-41c9-b3ef-de69d8f3b12d tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-e490b4b8-2410-4e91-913b-641346d5e735-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-af50e45f-acd2-4156-8142-f4beb107d3a9-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-af50e45f-acd2-4156-8142-f4beb107d3a9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-af50e45f-acd2-4156-8142-f4beb107d3a9" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-af50e45f-acd2-4156-8142-f4beb107d3a9" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a342b390-b591-46fc-bf49-8cdc2938a05a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:02 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:02 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 is being set with open permissions: ugo+rw
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:02 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2
Apr 16 02:46:02 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:02 devstack sudo[91394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9
Apr 16 02:46:02 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-40804847-9111-4f38-8f24-0e0febcbf8e1-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-40804847-9111-4f38-8f24-0e0febcbf8e1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-quobyte-40804847-9111-4f38-8f24-0e0febcbf8e1" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-40804847-9111-4f38-8f24-0e0febcbf8e1" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d0eaa-8981-45a5-8193-fd5398a2524f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:02 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:02 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:02 devstack sudo[91403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9
Apr 16 02:46:02 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:02 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:02 devstack sudo[91402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1
Apr 16 02:46:02 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:02 devstack sudo[91405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.info
Apr 16 02:46:02 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:03 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.info" returned: 0 in 0.410s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:03 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.info is being set with open permissions: ugo+rw
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:03 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-af50e45f-acd2-4156-8142-f4beb107d3a9" returned: 0 in 0.457s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-af50e45f-acd2-4156-8142-f4beb107d3a9" released by "delete_volume" :: held 0.981s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:03 devstack sudo[91413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.info
Apr 16 02:46:03 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:03 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1" returned: 0 in 0.515s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Created reservations ['44de6e93-e1cf-4ddb-9bfa-9c9b37f285a5', '40846b7d-3b44-45f7-8649-cfbf5ab82ec1', '9e2c5ef8-872a-463b-92d6-5172baba6e67', '29ebb848-8e72-4410-8aa7-6f385659d75d'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:03 devstack sudo[91415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1
Apr 16 02:46:03 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:03 devstack sudo[91417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:03 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:03 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.info" returned: 0 in 0.445s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.937s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.659s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Creating offline snapshot 1a888ae6-6da9-47af-8490-f92c94175f0d of volume 10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:46:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-785f4927-17f1-4495-98f1-d1016fe8acac tempest-SnapshotDependencyTests-1678228329 None] Create snapshot completed successfully
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af80c3d-ebf6-4160-a46c-d8c2e4de974c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:03 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-40804847-9111-4f38-8f24-0e0febcbf8e1" returned: 0 in 0.459s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-40804847-9111-4f38-8f24-0e0febcbf8e1" released by "delete_volume" :: held 1.014s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created reservations ['18bb9499-c204-4e2a-a1eb-aa7f6bfd486d', '5cf93434-5725-416d-8d0a-4b01c75b191c', '9c05a6c4-c296-4c7e-b38e-2ea654959078', 'e5974c49-2414-4a0a-a30e-94537378b931'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:03 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:03 devstack sudo[91456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689
Apr 16 02:46:03 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:03 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Deleted volume successfully.
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-6ffa7600-5883-426f-9f60-87217ef0a7d4 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-af50e45f-acd2-4156-8142-f4beb107d3a9-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:03 devstack sudo[91458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:03 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:03 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689" returned: 0 in 0.487s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:03 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:04 devstack sudo[91464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d 1G
Apr 16 02:46:04 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:04 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:04 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Deleted volume successfully.
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d9d2de16-30ac-40a6-9f28-ade9121954e0 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-40804847-9111-4f38-8f24-0e0febcbf8e1-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Flow 'volume_create_manager' (3c8edbac-4567-4a79-812e-195e0e5547e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f356d0-1d9c-46c2-b90c-4561387d615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f356d0-1d9c-46c2-b90c-4561387d615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c27b3ba-e28d-4cfb-8088-7d76247c931a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7987af2c384fb9bc0991c6b8cf48b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0a2a2d8-dc9b-4062-994b-7eab55f3bab2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:04Z,use_quota=True,user_id='db8312b50c5e45b1abb5413b94ac8087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39232560-1f37-483f-97b6-96001fae2764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39232560-1f37-483f-97b6-96001fae2764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8450b179-b9da-4626-88ca-3bb8b4250fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8450b179-b9da-4626-88ca-3bb8b4250fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c27b3ba-e28d-4cfb-8088-7d76247c931a', 'volume_name': 'volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a', 'volume_size': 1, 'snapshot_id': 'b0a2a2d8-dc9b-4062-994b-7eab55f3bab2'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de96d542-ca5b-409a-9de7-4cd0cf655402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de96d542-ca5b-409a-9de7-4cd0cf655402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c215f40-e058-4ce4-b171-a981daacdf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Volume 8c27b3ba-e28d-4cfb-8088-7d76247c931a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a', 'volume_size': 1, 'snapshot_id': 'b0a2a2d8-dc9b-4062-994b-7eab55f3bab2'}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (2f5c2ee6-b215-4add-8589-2eaf72c9fda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62d8e9e-4802-4376-98dc-ac0392ec4c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62d8e9e-4802-4376-98dc-ac0392ec4c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1976556910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f84fb2-1bba-4c90-8709-a07c8ffe6e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842155ac11a74e94a00d410bf6186d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:04Z,use_quota=True,user_id='7a2b53c997134211b24ac3bf93ec2be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0e477a-367b-427c-a430-3f5ecbc5f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0e477a-367b-427c-a430-3f5ecbc5f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0221d7d7-a960-42bc-9298-c45a8abc0d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0221d7d7-a960-42bc-9298-c45a8abc0d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f84fb2-1bba-4c90-8709-a07c8ffe6e54', 'volume_name': 'volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a07d44-ca45-4f44-ae85-632861113e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a07d44-ca45-4f44-ae85-632861113e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f13cbf1-8a88-4f85-93ed-3586cd0e2de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:04 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Volume f2f84fb2-1bba-4c90-8709-a07c8ffe6e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54', 'volume_size': 1}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:04 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d 1G" returned: 0 in 0.597s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10f6e75a-5214-4e74-a164-6b0a7f919689 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:04 devstack sudo[91470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10f6e75a-5214-4e74-a164-6b0a7f919689 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d
Apr 16 02:46:04 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-95ae20c3-9798-49d7-af64-5d81e007a441-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-95ae20c3-9798-49d7-af64-5d81e007a441-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "cinder-quobyte-95ae20c3-9798-49d7-af64-5d81e007a441" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-95ae20c3-9798-49d7-af64-5d81e007a441" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a77720-3d97-4e06-901a-689a51d6582b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:04 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:04 devstack sudo[91472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441
Apr 16 02:46:04 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:05 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10f6e75a-5214-4e74-a164-6b0a7f919689 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d" returned: 0 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:05 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d is being set with open permissions: ugo+rw
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:05 devstack sudo[91478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d
Apr 16 02:46:05 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:05 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:05 devstack sudo[91483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441
Apr 16 02:46:05 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:05 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d" returned: 0 in 0.456s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:05 devstack sudo[91486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.info
Apr 16 02:46:05 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:05 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-95ae20c3-9798-49d7-af64-5d81e007a441" returned: 0 in 0.485s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-quobyte-95ae20c3-9798-49d7-af64-5d81e007a441" released by "delete_volume" :: held 1.015s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Created reservations ['79476bf0-6380-41e8-8b01-b3a369eeb413', '4825fe32-bf3e-456f-a5c5-a3e8a8c52ae3', '95440662-b275-4b8d-8b93-a31a3548923d', 'a7b4d0b8-03f3-40f8-9826-d39fb1870864'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:05 devstack sudo[91489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:05 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:05 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.info" returned: 0 in 0.462s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:05 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.info is being set with open permissions: ugo+rw
Apr 16 02:46:05 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:06 devstack sudo[91492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.info
Apr 16 02:46:06 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:06 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.466s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Deleted volume successfully.
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a5101f0-d405-4a48-a0cf-1c57600ceee4 tempest-CreateVolumesFromSourceVolumeTest-198084830 None] Lock "cinder-95ae20c3-9798-49d7-af64-5d81e007a441-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:06 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.info" returned: 0 in 0.442s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.986s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.996s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-quobyte-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2-8c27b3ba-e28d-4cfb-8088-7d76247c931a" by "_create_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2-8c27b3ba-e28d-4cfb-8088-7d76247c931a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Creating volume 8c27b3ba-e28d-4cfb-8088-7d76247c931a from snapshot b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-quobyte-8c27b3ba-e28d-4cfb-8088-7d76247c931a" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:06 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b8971f1b-5721-4e3f-88e3-012741da85d4 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Create snapshot completed successfully
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-8c27b3ba-e28d-4cfb-8088-7d76247c931a" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] snapshot: b0a2a2d8-dc9b-4062-994b-7eab55f3bab2, volume: 8c27b3ba-e28d-4cfb-8088-7d76247c931a,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37077cd-de27-4e26-91f7-7b244f0d969c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:06 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:06 devstack sudo[91496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2
Apr 16 02:46:06 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:07 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" returned: 0 in 0.598s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f12606d1-7222-44f9-a6ec-45dccdec19a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[601fa088-9457-419b-af92-be4890d5383f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:07 devstack sudo[91501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1
Apr 16 02:46:07 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (d264cb56-2d90-4e29-912b-d7f744504464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d802dab1-f33c-444e-a56e-87428eef6cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d802dab1-f33c-444e-a56e-87428eef6cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-760316413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60112683-53d9-4ad4-84d5-1bd2c232e1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:07Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebdaf85-7311-4a8e-832e-e9fbd334a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebdaf85-7311-4a8e-832e-e9fbd334a227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce15733-e8c0-4be4-bde8-51f84c8140b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce15733-e8c0-4be4-bde8-51f84c8140b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60112683-53d9-4ad4-84d5-1bd2c232e1e1', 'volume_name': 'volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e1b24f-3ada-46fc-b995-7d94aa09031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e1b24f-3ada-46fc-b995-7d94aa09031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ac321a-0d8b-4b66-bde4-97c8f8d9f827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume 60112683-53d9-4ad4-84d5-1bd2c232e1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1', 'volume_size': 1}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (3dc032d1-c575-4956-8ca4-cb0b1461d1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61929a5a-0c18-4176-8475-7a6dac753498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61929a5a-0c18-4176-8475-7a6dac753498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057987142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd3e7ae-c877-4799-9300-773cf9b1f401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:07Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50ce414-5edf-4dfb-9668-edd5b6d60555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50ce414-5edf-4dfb-9668-edd5b6d60555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0015d71e-37f8-4863-a6bc-281c6dcf33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0015d71e-37f8-4863-a6bc-281c6dcf33ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd3e7ae-c877-4799-9300-773cf9b1f401', 'volume_name': 'volume-9cd3e7ae-c877-4799-9300-773cf9b1f401', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f9200c-4d77-473b-81bf-cc0b794ac839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f9200c-4d77-473b-81bf-cc0b794ac839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c2981-d01f-4084-8cd2-8ac8718aa5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume 9cd3e7ae-c877-4799-9300-773cf9b1f401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd3e7ae-c877-4799-9300-773cf9b1f401', 'volume_size': 1}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:07 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (93ff9f87-b29d-469a-a709-5f528f2116b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f2d71c-323f-4941-81ca-1cf67d6ba45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f2d71c-323f-4941-81ca-1cf67d6ba45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722909765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6c1ebe-3370-4411-bc3c-7410a3203e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:08Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdf061b-c222-4412-aedb-2938c1af27c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdf061b-c222-4412-aedb-2938c1af27c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42594ec4-5bbb-4788-9c31-9f99ab26e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42594ec4-5bbb-4788-9c31-9f99ab26e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6c1ebe-3370-4411-bc3c-7410a3203e3b', 'volume_name': 'volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f62f55-1392-4bd0-a81c-945919b0f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f62f55-1392-4bd0-a81c-945919b0f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd74e8e-10eb-4033-bf95-d4360d94e578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:07 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume fc6c1ebe-3370-4411-bc3c-7410a3203e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b', 'volume_size': 1}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1" returned: 0 in 0.689s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:07 devstack sudo[91506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a
Apr 16 02:46:07 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (5bb296df-d7f1-42dd-b9cc-6a5f4449083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:07 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b55ac5-6a1c-42ff-bdb6-9916fd004ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b55ac5-6a1c-42ff-bdb6-9916fd004ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19489232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e122b2f0-055d-498d-a6b8-3be9a31ab3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:08Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c356e4d-c58b-4b85-9e44-865d17c36977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c356e4d-c58b-4b85-9e44-865d17c36977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b81d47-403b-458e-b351-aaeff447463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b81d47-403b-458e-b351-aaeff447463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e122b2f0-055d-498d-a6b8-3be9a31ab3f4', 'volume_name': 'volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7b9dd5-fa08-4b68-a8b8-a5e2b89d4a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7b9dd5-fa08-4b68-a8b8-a5e2b89d4a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5a4460-aa5d-478e-b986-4b428ed7c9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume e122b2f0-055d-498d-a6b8-3be9a31ab3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4', 'volume_size': 1}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (90e06f3e-b707-47e8-a3e4-0975289faaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cd69c0-d556-45e5-b9ea-80a3d00d8c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cd69c0-d556-45e5-b9ea-80a3d00d8c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372438754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfad20b1-767e-4639-a910-0de69e17dafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:08Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3dac5e-07f9-4644-95fe-7f89258b1809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3dac5e-07f9-4644-95fe-7f89258b1809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636ae861-e2da-4559-992a-481fa98c84ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636ae861-e2da-4559-992a-481fa98c84ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfad20b1-767e-4639-a910-0de69e17dafa', 'volume_name': 'volume-dfad20b1-767e-4639-a910-0de69e17dafa', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295f6b08-94b8-43dd-b225-3d9989b0295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295f6b08-94b8-43dd-b225-3d9989b0295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b47fb4-999b-4390-8206-14bc486030f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:08 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume dfad20b1-767e-4639-a910-0de69e17dafa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfad20b1-767e-4639-a910-0de69e17dafa', 'volume_size': 1}
Apr 16 02:46:08 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Flow 'volume_create_manager' (025d4973-5ec5-420d-94c4-0cb3e4889017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9fe9ad-7eea-4ff6-a35e-5d15f9c62fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9fe9ad-7eea-4ff6-a35e-5d15f9c62fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64caf7fc-ae06-4cea-8b46-79032213d518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e801e1e2228d49b1bb38167d33b69fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:10Z,use_quota=True,user_id='fa40584ed1574cdfbc56146e5625dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7612bbe1-cbcc-4173-a27f-3276c01e8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7612bbe1-cbcc-4173-a27f-3276c01e8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd0cc0c-b6ba-4bd5-a87f-79b03956ba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd0cc0c-b6ba-4bd5-a87f-79b03956ba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64caf7fc-ae06-4cea-8b46-79032213d518', 'volume_name': 'volume-64caf7fc-ae06-4cea-8b46-79032213d518', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b71e226-39b8-4b1f-ae1b-67c50afd0afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b71e226-39b8-4b1f-ae1b-67c50afd0afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1f5a79-c053-424a-90af-cbfcc53bb58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:09 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Volume 64caf7fc-ae06-4cea-8b46-79032213d518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64caf7fc-ae06-4cea-8b46-79032213d518', 'volume_size': 1}
Apr 16 02:46:09 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:10 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a" returned: 0 in 2.533s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:10 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeded3a-b0a5-43d3-bb60-04f22f198e98]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:10 devstack sudo[91519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1
Apr 16 02:46:10 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:10 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1" returned: 0 in 0.612s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:10 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:46:10 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Converted 1024.00 MB image at 404.08 MB/s
Apr 16 02:46:10 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a is being set with open permissions: ugo+rw
Apr 16 02:46:10 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:11 devstack sudo[91524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a
Apr 16 02:46:11 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:11 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a" returned: 0 in 0.431s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-8c27b3ba-e28d-4cfb-8088-7d76247c931a" released by "_copy_volume_from_snapshot" :: held 4.927s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2-8c27b3ba-e28d-4cfb-8088-7d76247c931a" released by "_create_volume_from_snapshot" :: held 4.950s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.965s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.888s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1976556910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f84fb2-1bba-4c90-8709-a07c8ffe6e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842155ac11a74e94a00d410bf6186d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:04Z,use_quota=True,user_id='7a2b53c997134211b24ac3bf93ec2be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Creating volume f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:11 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:11 devstack sudo[91527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 1073741824
Apr 16 02:46:11 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c215f40-e058-4ce4-b171-a981daacdf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a', 'volume_size': 1, 'snapshot_id': 'b0a2a2d8-dc9b-4062-994b-7eab55f3bab2'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0d02f5-9840-438b-a477-1c8794a2db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:11 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Volume volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a (8c27b3ba-e28d-4cfb-8088-7d76247c931a): created successfully
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0d02f5-9840-438b-a477-1c8794a2db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Flow 'volume_create_manager' (3c8edbac-4567-4a79-812e-195e0e5547e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:11 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-96c55e14-6843-4e73-ade3-7c925b88a6a6 tempest-SnapshotDependencyTests-1678228329 None] Created volume successfully.
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-quobyte-f12606d1-7222-44f9-a6ec-45dccdec19a1" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-f12606d1-7222-44f9-a6ec-45dccdec19a1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-quobyte-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Deleting offline snapshot b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 of volume f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] snapshot_file for this snap is: volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841644a-12dd-4df1-8f35-4e555107762f]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:11 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:11 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 1073741824" returned: 0 in 0.563s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:12 devstack sudo[91533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54
Apr 16 02:46:12 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:12 devstack sudo[91532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2
Apr 16 02:46:12 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:12 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" returned: 0 in 0.431s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.149s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-760316413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60112683-53d9-4ad4-84d5-1bd2c232e1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:07Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Creating volume 60112683-53d9-4ad4-84d5-1bd2c232e1e1 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:12 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:12 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" returned: 0 in 0.499s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f12606d1-7222-44f9-a6ec-45dccdec19a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:46:12 devstack sudo[91540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1 1073741824
Apr 16 02:46:12 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f13cbf1-8a88-4f85-93ed-3586cd0e2de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc991a6-6c98-4957-bad2-f252e1c46076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[563125bb-14d9-4f12-a1ff-f44706309508]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:12 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Volume volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 (f2f84fb2-1bba-4c90-8709-a07c8ffe6e54): created successfully
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc991a6-6c98-4957-bad2-f252e1c46076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (2f5c2ee6-b215-4add-8589-2eaf72c9fda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:12 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-b68b7d5a-704b-43ba-83ab-cc9a576de5ca tempest-VolumeDependencyTests-456622533 None] Created volume successfully.
Apr 16 02:46:12 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1
Apr 16 02:46:12 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:12 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1 1073741824" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:12 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:13 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1
Apr 16 02:46:13 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:13 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1" returned: 0 in 0.525s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:13 devstack sudo[91552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2
Apr 16 02:46:13 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (54dd04a8-442a-432c-9972-f168bed7ff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e1440c-b852-4f24-ac56-df6ef1500882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e1440c-b852-4f24-ac56-df6ef1500882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2014854483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441cdb1a-421e-477e-b2dd-4425d0c22250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842155ac11a74e94a00d410bf6186d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f2f84fb2-1bba-4c90-8709-a07c8ffe6e54,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:13Z,use_quota=True,user_id='7a2b53c997134211b24ac3bf93ec2be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b47f35-32ea-4580-82b6-23f200597afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b47f35-32ea-4580-82b6-23f200597afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24db2781-1aee-40de-ade0-8aa63a90623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24db2781-1aee-40de-ade0-8aa63a90623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '441cdb1a-421e-477e-b2dd-4425d0c22250', 'volume_name': 'volume-441cdb1a-421e-477e-b2dd-4425d0c22250', 'volume_size': 1, 'source_volid': 'f2f84fb2-1bba-4c90-8709-a07c8ffe6e54', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d666ba-7caa-4667-a6e1-7d2a5faa1cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d666ba-7caa-4667-a6e1-7d2a5faa1cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf0d16e-1fbb-4f5e-9c10-51f85aa09443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:13 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Volume 441cdb1a-421e-477e-b2dd-4425d0c22250: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-441cdb1a-421e-477e-b2dd-4425d0c22250', 'volume_size': 1, 'source_volid': 'f2f84fb2-1bba-4c90-8709-a07c8ffe6e54', 'source_volstatus': 'available'}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:13 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1" returned: 0 in 0.510s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.902s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057987142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd3e7ae-c877-4799-9300-773cf9b1f401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:07Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Creating volume 9cd3e7ae-c877-4799-9300-773cf9b1f401 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:13 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ac321a-0d8b-4b66-bde4-97c8f8d9f827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d48dd4-b105-46d5-b5b7-215a366e0b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:13 devstack sudo[91558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401 1073741824
Apr 16 02:46:13 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:13 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" returned: 0 in 0.491s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:13 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1 (60112683-53d9-4ad4-84d5-1bd2c232e1e1): created successfully
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d48dd4-b105-46d5-b5b7-215a366e0b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:13 devstack sudo[91560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2
Apr 16 02:46:13 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (d264cb56-2d90-4e29-912b-d7f744504464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:13 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e3aa6422-2894-45c6-8655-543b6257defc tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created volume successfully.
Apr 16 02:46:13 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1.b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:13 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:13 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401 1073741824" returned: 0 in 0.487s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2" released by "_delete_snapshot" :: held 2.059s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-f12606d1-7222-44f9-a6ec-45dccdec19a1" released by "delete_snapshot" :: held 2.072s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:14 devstack sudo[91566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401
Apr 16 02:46:14 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Created reservations ['a330a02a-500b-431b-a13a-587f5b47b329', 'a83e6491-8bdf-4e37-8f8a-54ce8019aadf', '90294dd8-343e-4446-b151-f2b5ae10ddee', '825ec46d-f4ac-46fc-bad8-b0c98672e723'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:14 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Delete snapshot completed successfully.
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-d874285f-93a4-4846-84e7-45099b108925 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-b0a2a2d8-dc9b-4062-994b-7eab55f3bab2-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:14 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401" returned: 0 in 0.448s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.665s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722909765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6c1ebe-3370-4411-bc3c-7410a3203e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:08Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Creating volume fc6c1ebe-3370-4411-bc3c-7410a3203e3b {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:14 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6c2981-d01f-4084-8cd2-8ac8718aa5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd3e7ae-c877-4799-9300-773cf9b1f401', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c86b7c-1f34-4153-ad57-b1e55d9c3a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:14 devstack sudo[91569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b 1073741824
Apr 16 02:46:14 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:14 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume volume-9cd3e7ae-c877-4799-9300-773cf9b1f401 (9cd3e7ae-c877-4799-9300-773cf9b1f401): created successfully
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c86b7c-1f34-4153-ad57-b1e55d9c3a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:14 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (3dc032d1-c575-4956-8ca4-cb0b1461d1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:14 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1a1e4351-5327-4e17-b32e-a198a90f6204 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created volume successfully.
Apr 16 02:46:15 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b 1073741824" returned: 0 in 0.522s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:15 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b
Apr 16 02:46:15 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-f12606d1-7222-44f9-a6ec-45dccdec19a1-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-f12606d1-7222-44f9-a6ec-45dccdec19a1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-quobyte-f12606d1-7222-44f9-a6ec-45dccdec19a1" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-f12606d1-7222-44f9-a6ec-45dccdec19a1" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eef6e6-2399-4d5a-857e-f1e9b3fd194a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:15 devstack sudo[91577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1
Apr 16 02:46:15 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:15 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b" returned: 0 in 0.464s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.467s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19489232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e122b2f0-055d-498d-a6b8-3be9a31ab3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:08Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Creating volume e122b2f0-055d-498d-a6b8-3be9a31ab3f4 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:15 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd74e8e-10eb-4033-bf95-d4360d94e578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72992ab7-cc25-4943-8df9-a3aceff6f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:15 devstack sudo[91580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4 1073741824
Apr 16 02:46:15 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:15 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b (fc6c1ebe-3370-4411-bc3c-7410a3203e3b): created successfully
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72992ab7-cc25-4943-8df9-a3aceff6f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (93ff9f87-b29d-469a-a709-5f528f2116b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:15 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-aed0f681-0aee-4c7b-90d2-2a6515b54d53 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created volume successfully.
Apr 16 02:46:15 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1" returned: 0 in 0.578s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:15 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:15 devstack sudo[91585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1
Apr 16 02:46:15 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:16 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4 1073741824" returned: 0 in 0.512s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:16 devstack sudo[91590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4
Apr 16 02:46:16 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:16 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f12606d1-7222-44f9-a6ec-45dccdec19a1" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-f12606d1-7222-44f9-a6ec-45dccdec19a1" released by "delete_volume" :: held 1.100s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Created reservations ['48251ae0-7686-4ac1-a7af-c3009c7ae890', '86effec2-fbba-4048-9b23-7070501f2556', '9e4e9306-173e-4e64-976c-e5595a16abef', '48b2e069-e350-466f-903d-aba45b7febdf'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:16 devstack sudo[91593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:16 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:16 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.239s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372438754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfad20b1-767e-4639-a910-0de69e17dafa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f261a7bddd744405ad87543045270d6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:08Z,use_quota=True,user_id='69a636b67bf54147a102da64b506a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Creating volume dfad20b1-767e-4639-a910-0de69e17dafa {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:16 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5a4460-aa5d-478e-b986-4b428ed7c9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:16 devstack sudo[91596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa 1073741824
Apr 16 02:46:16 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241ebf9c-4c73-4141-9ff0-66d287d5739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:16 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4 (e122b2f0-055d-498d-a6b8-3be9a31ab3f4): created successfully
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241ebf9c-4c73-4141-9ff0-66d287d5739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (5bb296df-d7f1-42dd-b9cc-6a5f4449083e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-94112ea8-e733-4961-a55e-e5ad074c5e95 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created volume successfully.
Apr 16 02:46:16 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.477s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:16 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Deleted volume successfully.
Apr 16 02:46:16 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-71d88b65-59c6-4938-bd5b-cb265cf21a73 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-f12606d1-7222-44f9-a6ec-45dccdec19a1-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:17 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa 1073741824" returned: 0 in 0.510s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:17 devstack sudo[91602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa
Apr 16 02:46:17 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-8c27b3ba-e28d-4cfb-8088-7d76247c931a-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-8c27b3ba-e28d-4cfb-8088-7d76247c931a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "cinder-quobyte-8c27b3ba-e28d-4cfb-8088-7d76247c931a" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-8c27b3ba-e28d-4cfb-8088-7d76247c931a" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[55255671-cf4e-4a8a-b570-73f1b42af671]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:17 devstack sudo[91604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a
Apr 16 02:46:17 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:17 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa" returned: 0 in 0.441s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.882s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64caf7fc-ae06-4cea-8b46-79032213d518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e801e1e2228d49b1bb38167d33b69fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:10Z,use_quota=True,user_id='fa40584ed1574cdfbc56146e5625dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Creating volume 64caf7fc-ae06-4cea-8b46-79032213d518 {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:17 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b47fb4-999b-4390-8206-14bc486030f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfad20b1-767e-4639-a910-0de69e17dafa', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:17 devstack sudo[91607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518 1073741824
Apr 16 02:46:17 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3deaea-9651-4249-8b0e-8eb039305150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:17 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Volume volume-dfad20b1-767e-4639-a910-0de69e17dafa (dfad20b1-767e-4639-a910-0de69e17dafa): created successfully
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3deaea-9651-4249-8b0e-8eb039305150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Flow 'volume_create_manager' (90e06f3e-b707-47e8-a3e4-0975289faaf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:17 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f7ad76c1-83fe-4edb-9625-102c5ede45ba tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created volume successfully.
Apr 16 02:46:17 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a" returned: 0 in 0.520s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:17 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:17 devstack sudo[91612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a
Apr 16 02:46:17 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-dfad20b1-767e-4639-a910-0de69e17dafa-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-dfad20b1-767e-4639-a910-0de69e17dafa-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-dfad20b1-767e-4639-a910-0de69e17dafa" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-dfad20b1-767e-4639-a910-0de69e17dafa" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9f72f3-0657-4e26-a4e6-99acb3eda11d]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:18 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518 1073741824" returned: 0 in 0.554s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:18 devstack sudo[91618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518
Apr 16 02:46:18 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:18 devstack sudo[91617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa
Apr 16 02:46:18 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:18 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-8c27b3ba-e28d-4cfb-8088-7d76247c931a" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-quobyte-8c27b3ba-e28d-4cfb-8088-7d76247c931a" released by "delete_volume" :: held 1.035s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Created reservations ['c392f237-4140-49d8-a481-5dc976d39822', '71ed20c6-2026-4959-968c-12336c537117', 'b18771dd-7c47-410b-af89-6430d2415804', '7a7ff10a-8d17-41f0-b99d-b62eec79008c'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:18 devstack sudo[91622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:18 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:18 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.141s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:18 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Cloning volume f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 to volume 441cdb1a-421e-477e-b2dd-4425d0c22250
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1f5a79-c053-424a-90af-cbfcc53bb58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64caf7fc-ae06-4cea-8b46-79032213d518', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39d9bc3-5e04-4020-8984-be2542e3cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:18 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Volume volume-64caf7fc-ae06-4cea-8b46-79032213d518 (64caf7fc-ae06-4cea-8b46-79032213d518): created successfully
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d39d9bc3-5e04-4020-8984-be2542e3cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Flow 'volume_create_manager' (025d4973-5ec5-420d-94c4-0cb3e4889017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Creating offline snapshot 5dea6775-a161-4bee-8ca8-cab83d131c2d of volume f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:46:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-f3d187b8-d997-4daf-ab25-7e79ffa7d524 tempest-CinderUnicodeTest-585572987 None] Created volume successfully.
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[178d43ad-24dd-4cc9-8702-76d17b2e463b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:18 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa" returned: 0 in 0.568s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:18 devstack sudo[91629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa
Apr 16 02:46:18 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:18 devstack sudo[91628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54
Apr 16 02:46:18 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:18 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.461s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:18 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Deleted volume successfully.
Apr 16 02:46:18 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-3d91d4eb-e986-479f-ab5f-a0d21639b178 tempest-SnapshotDependencyTests-1678228329 None] Lock "cinder-8c27b3ba-e28d-4cfb-8088-7d76247c931a-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:19 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-dfad20b1-767e-4639-a910-0de69e17dafa" returned: 0 in 0.481s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:19 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-dfad20b1-767e-4639-a910-0de69e17dafa" released by "delete_volume" :: held 1.072s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" returned: 0 in 0.508s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:19 devstack sudo[91637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d 1G
Apr 16 02:46:19 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created reservations ['46816eb8-7656-48af-a209-c02369a4dbf2', '87a2339d-3f15-458c-927a-18240b3f4572', 'a50d4e21-f996-4c90-ae8a-377a3fd251e5', 'b2e2ba65-2ff9-480c-aa3d-d2968f957e65'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:19 devstack sudo[91639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:19 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.flows.manager.create_volume [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83205) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Flow 'volume_create_manager' (0fc895ee-7843-4403-9b1d-38b30b34d9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ffcf36-3747-4d6d-a4f5-8d4f1836a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ffcf36-3747-4d6d-a4f5-8d4f1836a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-569991744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e801e1e2228d49b1bb38167d33b69fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:19Z,use_quota=True,user_id='fa40584ed1574cdfbc56146e5625dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51846aee-409e-459e-b6e1-62c0671cb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51846aee-409e-459e-b6e1-62c0671cb51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88338886-93cf-47e6-84d6-974cfeb902b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88338886-93cf-47e6-84d6-974cfeb902b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23df57e-edfc-4e8b-8a30-76c7f4c2ea4e', 'volume_name': 'volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95169151-3eee-43aa-88af-2b81e8f20ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95169151-3eee-43aa-88af-2b81e8f20ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452a2cca-9c82-4acf-94a0-615e9a9244b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:19 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Volume d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e', 'volume_size': 1}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:19 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d 1G" returned: 0 in 0.569s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:19 devstack sudo[91645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d
Apr 16 02:46:19 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:19 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.501s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:19 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Deleted volume successfully.
Apr 16 02:46:19 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-025dac19-f35d-43b4-a163-9a17ff2a2a9f tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-dfad20b1-767e-4639-a910-0de69e17dafa-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:20 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d" returned: 0 in 0.477s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:20 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d is being set with open permissions: ugo+rw
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-e122b2f0-055d-498d-a6b8-3be9a31ab3f4-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:20 devstack sudo[91650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d
Apr 16 02:46:20 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-e122b2f0-055d-498d-a6b8-3be9a31ab3f4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-e122b2f0-055d-498d-a6b8-3be9a31ab3f4" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-e122b2f0-055d-498d-a6b8-3be9a31ab3f4" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba28160-12e4-403d-aa81-7c4803fe6daf]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:20 devstack sudo[91652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4
Apr 16 02:46:20 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:20 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d" returned: 0 in 0.511s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:20 devstack sudo[91657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.info
Apr 16 02:46:20 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:20 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4" returned: 0 in 0.555s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:20 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:20 devstack sudo[91661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4
Apr 16 02:46:20 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:21 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.info" returned: 0 in 0.467s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:21 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.info is being set with open permissions: ugo+rw
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:21 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.info
Apr 16 02:46:21 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:21 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-e122b2f0-055d-498d-a6b8-3be9a31ab3f4" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-e122b2f0-055d-498d-a6b8-3be9a31ab3f4" released by "delete_volume" :: held 1.058s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created reservations ['9848f5f4-2bb5-4357-a670-16a0ae161e9c', '222cbf0f-ea1a-42ff-8dbe-0286d49a4d2c', '412b30e0-a7a6-49c6-a954-1cf32c2faccb', 'afee51ea-a2c5-40df-9826-9d65b127c5bf'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:21 devstack sudo[91667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:21 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:21 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.info" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-441cdb1a-421e-477e-b2dd-4425d0c22250" by "_copy_volume_from_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-441cdb1a-421e-477e-b2dd-4425d0c22250" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] snapshot: 5dea6775-a161-4bee-8ca8-cab83d131c2d, volume: 441cdb1a-421e-477e-b2dd-4425d0c22250,  {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f30d77-3297-4b1a-a362-874dccac6430]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:21 devstack sudo[91670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d
Apr 16 02:46:21 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:21 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:21 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Deleted volume successfully.
Apr 16 02:46:21 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7adc0ca-21f2-4713-afa8-a1ce354b97fa tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-e122b2f0-055d-498d-a6b8-3be9a31ab3f4-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:22 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d" returned: 0 in 0.494s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Creating direct copy from snapshot {{(pid=83205) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28af8ee-e4ca-4b71-bfe2-7f1fab7e9109]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:22 devstack sudo[91676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54
Apr 16 02:46:22 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-fc6c1ebe-3370-4411-bc3c-7410a3203e3b-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-fc6c1ebe-3370-4411-bc3c-7410a3203e3b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-fc6c1ebe-3370-4411-bc3c-7410a3203e3b" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-fc6c1ebe-3370-4411-bc3c-7410a3203e3b" acquired by "delete_volume" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893662c-0a2c-49b1-ab15-9de606a9b39c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:22 devstack sudo[91678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b
Apr 16 02:46:22 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:22 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" returned: 0 in 0.667s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG cinder.utils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Path /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250 not found in is_blk_device check {{(pid=83205) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 16 02:46:22 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:22 devstack sudo[91684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250
Apr 16 02:46:22 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:23 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b" returned: 0 in 0.576s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:23 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:23 devstack sudo[91689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b
Apr 16 02:46:23 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:24 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-fc6c1ebe-3370-4411-bc3c-7410a3203e3b" returned: 0 in 0.976s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-fc6c1ebe-3370-4411-bc3c-7410a3203e3b" released by "delete_volume" :: held 1.595s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created reservations ['8083b1ad-5b24-4bcb-96bc-ceca2b06ff88', '392229f7-3b5a-4229-9f5f-0b93236aa50f', 'c6cb7a12-9389-41d8-8895-acdba01de2be', 'e8052306-a5f7-44ea-901a-c4629ada4b8f'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:24 devstack sudo[91703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:24 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-9cd3e7ae-c877-4799-9300-773cf9b1f401-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:24 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-9cd3e7ae-c877-4799-9300-773cf9b1f401-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-9cd3e7ae-c877-4799-9300-773cf9b1f401" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-9cd3e7ae-c877-4799-9300-773cf9b1f401" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5a5f5-15a2-4206-95d4-e8c9d5520329]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:25 devstack sudo[91706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401
Apr 16 02:46:25 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:25 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250" returned: 0 in 2.523s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[987abad9-565b-4361-93a4-13d43a33ad87]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:25 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:25 devstack sudo[91709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 1.061s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:25 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:25 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Deleted volume successfully.
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-aeb7628d-594f-4a2c-a197-fec225258680 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-fc6c1ebe-3370-4411-bc3c-7410a3203e3b-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:25 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401" returned: 0 in 0.676s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:25 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:25 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401
Apr 16 02:46:25 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:26 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" returned: 0 in 0.706s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.image.image_utils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Image conversion details: src /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250 {{(pid=83205) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 16 02:46:26 devstack cinder-volume[83205]: INFO cinder.image.image_utils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Converted 1024.00 MB image at 405.72 MB/s
Apr 16 02:46:26 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250 is being set with open permissions: ugo+rw
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:26 devstack sudo[91719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250
Apr 16 02:46:26 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:26 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-9cd3e7ae-c877-4799-9300-773cf9b1f401" returned: 0 in 0.507s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-9cd3e7ae-c877-4799-9300-773cf9b1f401" released by "delete_volume" :: held 1.241s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created reservations ['4e889e62-a242-4ad9-aa80-21dbe5451a9a', '2dfc8a6d-408f-49bf-97b7-35a994ea693e', 'bcbbf282-ecf8-4b69-9452-037d1cfcf0f7', '6be1eb58-c4e2-4ff8-8a14-6c44b49af9a7'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:26 devstack sudo[91722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:26 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:26 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250" returned: 0 in 0.450s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-441cdb1a-421e-477e-b2dd-4425d0c22250" released by "_copy_volume_from_snapshot" :: held 4.895s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-5dea6775-a161-4bee-8ca8-cab83d131c2d" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-5dea6775-a161-4bee-8ca8-cab83d131c2d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Deleting offline snapshot 5dea6775-a161-4bee-8ca8-cab83d131c2d of volume f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] snapshot_file for this snap is: volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[f735e121-e471-40df-a01c-2d928d2e20eb]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:26 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:26 devstack sudo[91726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d
Apr 16 02:46:26 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:27 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.561s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:27 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Deleted volume successfully.
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-a7b4585e-65f4-4943-a1da-10598793a776 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-9cd3e7ae-c877-4799-9300-773cf9b1f401-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:27 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d" returned: 0 in 0.522s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea544ea-3f82-40eb-814c-ae6d5e308d9b]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-60112683-53d9-4ad4-84d5-1bd2c232e1e1-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-60112683-53d9-4ad4-84d5-1bd2c232e1e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:27 devstack sudo[91732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54
Apr 16 02:46:27 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-60112683-53d9-4ad4-84d5-1bd2c232e1e1" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-60112683-53d9-4ad4-84d5-1bd2c232e1e1" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[da49c2ae-d76a-4df1-bf9b-e9d8191fdf34]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:27 devstack sudo[91734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1
Apr 16 02:46:27 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:27 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" returned: 0 in 0.625s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:27 devstack sudo[91742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d
Apr 16 02:46:27 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:27 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1" returned: 0 in 0.541s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:27 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:27 devstack sudo[91744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1
Apr 16 02:46:27 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:28 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d" returned: 0 in 0.497s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:28 devstack sudo[91750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d
Apr 16 02:46:28 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:28 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-60112683-53d9-4ad4-84d5-1bd2c232e1e1" returned: 0 in 0.465s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-60112683-53d9-4ad4-84d5-1bd2c232e1e1" released by "delete_volume" :: held 1.031s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created reservations ['fa00c0d8-1431-4045-abe4-2f4e796cbada', 'e59b3bdc-49e3-4803-8679-f621a93b6db8', 'b82dd997-b8e9-45e2-bb22-16d8ac776899', 'bb69c41c-cbef-48a5-864f-d47dc6726855'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:28 devstack sudo[91752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:28 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:28 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54.5dea6775-a161-4bee-8ca8-cab83d131c2d" returned: 0 in 0.446s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-5dea6775-a161-4bee-8ca8-cab83d131c2d" released by "_delete_snapshot" :: held 2.151s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.247s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.446s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3d0113bd00>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-16T00:46:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-569991744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e801e1e2228d49b1bb38167d33b69fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T00:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T00:46:19Z,use_quota=True,user_id='fa40584ed1574cdfbc56146e5625dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(373ff528-f74e-4007-98e8-818b0dc9be09),volume_type_id=373ff528-f74e-4007-98e8-818b0dc9be09)}" {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Creating volume d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Selected osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5 as target Quobyte volume. {{(pid=83205) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 16 02:46:28 devstack cinder-volume[83205]: INFO cinder.volume.drivers.remotefs [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] casted to osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e 1073741824 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf0d16e-1fbb-4f5e-9c10-51f85aa09443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441cdb1a-421e-477e-b2dd-4425d0c22250', 'volume_size': 1, 'source_volid': 'f2f84fb2-1bba-4c90-8709-a07c8ffe6e54', 'source_volstatus': 'available'}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:28 devstack sudo[91756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e 1073741824
Apr 16 02:46:28 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77226d3-ee6e-412e-8db4-d4a373acf169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:28 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Volume volume-441cdb1a-421e-477e-b2dd-4425d0c22250 (441cdb1a-421e-477e-b2dd-4425d0c22250): created successfully
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77226d3-ee6e-412e-8db4-d4a373acf169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Flow 'volume_create_manager' (54dd04a8-442a-432c-9972-f168bed7ff7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:28 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.424s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-e2c3ee6e-4dfd-45e1-9514-01dd63c75dd9 tempest-VolumeDependencyTests-456622533 None] Created volume successfully.
Apr 16 02:46:28 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Deleted volume successfully.
Apr 16 02:46:28 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-1a27610f-7cbf-40cf-8e6b-91c31a387eeb tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-60112683-53d9-4ad4-84d5-1bd2c232e1e1-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:29 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e 1073741824" returned: 0 in 0.511s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:29 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e
Apr 16 02:46:29 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Lock "cinder-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-1a888ae6-6da9-47af-8490-f92c94175f0d-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" acquired by "delete_volume" :: waited 0.018s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e224e-5f38-4418-9a38-5ccaab28954e]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-1a888ae6-6da9-47af-8490-f92c94175f0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-10f6e75a-5214-4e74-a164-6b0a7f919689" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-10f6e75a-5214-4e74-a164-6b0a7f919689" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-1a888ae6-6da9-47af-8490-f92c94175f0d" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-1a888ae6-6da9-47af-8490-f92c94175f0d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Deleting offline snapshot 1a888ae6-6da9-47af-8490-f92c94175f0d of volume 10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] snapshot_file for this snap is: volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eb3c03-193b-49da-8cd7-eacd76b21154]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:29 devstack sudo[91763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54
Apr 16 02:46:29 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:29 devstack sudo[91764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d
Apr 16 02:46:29 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:29 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" returned: 0 in 0.463s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'} {{(pid=83205) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452a2cca-9c82-4acf-94a0-615e9a9244b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e', 'volume_size': 1}' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d744eb46-384d-4eb0-b8dd-37f96cdd943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 16 02:46:29 devstack cinder-volume[83205]: INFO cinder.volume.flows.manager.create_volume [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Volume volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e (d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e): created successfully
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d744eb46-384d-4eb0-b8dd-37f96cdd943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83205) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 16 02:46:29 devstack cinder-volume[83205]: DEBUG cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Flow 'volume_create_manager' (0fc895ee-7843-4403-9b1d-38b30b34d9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83205) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 16 02:46:29 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-0751949c-cb9c-4b44-9ea4-056fb6372d7e tempest-CinderUnicodeTest-585572987 None] Created volume successfully.
Apr 16 02:46:30 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" returned: 0 in 0.492s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:30 devstack sudo[91774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54
Apr 16 02:46:30 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:30 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d" returned: 0 in 0.542s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10f6e75a-5214-4e74-a164-6b0a7f919689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc4830-9b28-4412-98e5-e3ff5b99ab86]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:30 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689
Apr 16 02:46:30 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Creating offline snapshot b2aaf92c-5970-476f-84b3-5f26b95e3861 of volume d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c8cf19-324f-4e75-9cd7-d2ffc53bf752]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:30 devstack sudo[91778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e
Apr 16 02:46:30 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:30 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" returned: 0 in 0.526s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54" released by "delete_volume" :: held 1.059s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Created reservations ['0cf42159-9fea-49bc-85dd-95950a450f3a', 'fbe5040a-19f6-4c28-a2ee-43e49ea28f60', '86d2f98f-c87d-44a8-be3d-3eeef94644f6', 'db23bf0a-fe15-4053-8963-4d4334771905'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:30 devstack sudo[91784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:30 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:30 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689" returned: 0 in 0.537s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:30 devstack sudo[91786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d
Apr 16 02:46:30 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:30 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" returned: 0 in 0.549s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:30 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 1G {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:30 devstack sudo[91791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 1G
Apr 16 02:46:30 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:31 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.458s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Deleted volume successfully.
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-c20411a3-5ce8-49e4-9fb5-20946e7e866e tempest-VolumeDependencyTests-456622533 None] Lock "cinder-f2f84fb2-1bba-4c90-8709-a07c8ffe6e54-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:31 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d" returned: 0 in 0.482s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:31 devstack sudo[91797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d
Apr 16 02:46:31 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:31 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 1G" returned: 0 in 0.478s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:31 devstack sudo[91802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861
Apr 16 02:46:31 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-441cdb1a-421e-477e-b2dd-4425d0c22250-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:31 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Lock "cinder-441cdb1a-421e-477e-b2dd-4425d0c22250-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689.1a888ae6-6da9-47af-8490-f92c94175f0d" returned: 0 in 0.480s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-1a888ae6-6da9-47af-8490-f92c94175f0d" released by "_delete_snapshot" :: held 2.129s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-10f6e75a-5214-4e74-a164-6b0a7f919689" released by "delete_snapshot" :: held 2.149s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-441cdb1a-421e-477e-b2dd-4425d0c22250" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-441cdb1a-421e-477e-b2dd-4425d0c22250" acquired by "delete_volume" :: waited 0.017s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[492ef8de-991e-470e-b2d1-dedd26f2125a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created reservations ['455650cf-70d0-46d7-acd0-877c7025018c', '37a69969-215f-440f-aeed-a32734a070fb', '2e15248f-98fd-4352-b940-230d2740b3d6', 'c7787e18-cc80-4a27-bc01-6f397cd3315b'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:31 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250
Apr 16 02:46:31 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:31 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Delete snapshot completed successfully.
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-004dbac0-7303-4664-b039-2cb3fa13e894 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-1a888ae6-6da9-47af-8490-f92c94175f0d-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:31 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e -F qcow2 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861" returned: 0 in 0.508s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:31 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 is being set with open permissions: ugo+rw
Apr 16 02:46:31 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:31 devstack sudo[91810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861
Apr 16 02:46:31 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:32 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:32 devstack sudo[91816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250
Apr 16 02:46:32 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:32 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861" returned: 0 in 0.412s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:32 devstack sudo[91818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.info
Apr 16 02:46:32 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-10f6e75a-5214-4e74-a164-6b0a7f919689-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-10f6e75a-5214-4e74-a164-6b0a7f919689-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:32 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-441cdb1a-421e-477e-b2dd-4425d0c22250" returned: 0 in 0.480s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-441cdb1a-421e-477e-b2dd-4425d0c22250" released by "delete_volume" :: held 1.013s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "cinder-quobyte-10f6e75a-5214-4e74-a164-6b0a7f919689" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-10f6e75a-5214-4e74-a164-6b0a7f919689" acquired by "delete_volume" :: waited 0.021s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1bc44a-56d0-48d6-803d-5124164c8291]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Created reservations ['2f85825d-188d-4276-bb42-210cb1a1bec3', 'b85b859f-e8fe-44d3-a29c-c4a6879d4c0e', '07240f98-04fa-491a-867e-c0c24e9ec473', 'a11920c4-8c01-410b-a683-108189b695fa'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:32 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.info" returned: 0 in 0.509s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:32 devstack cinder-volume[83205]: WARNING cinder.volume.drivers.remotefs [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.info is being set with open permissions: ugo+rw
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.info {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:32 devstack sudo[91822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689
Apr 16 02:46:32 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:32 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.info
Apr 16 02:46:32 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:32 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:32 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:32 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:33 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.info" returned: 0 in 0.421s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.938s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:33 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689" returned: 0 in 0.502s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:33 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-cc5cdea6-1aea-4393-86b9-797cf6b9849c tempest-CinderUnicodeTest-585572987 None] Create snapshot completed successfully
Apr 16 02:46:33 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689
Apr 16 02:46:33 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:33 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.435s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:33 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Deleted volume successfully.
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-45af5146-1b89-4981-a2b3-47779065a2bb tempest-VolumeDependencyTests-456622533 None] Lock "cinder-441cdb1a-421e-477e-b2dd-4425d0c22250-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Acquiring lock "cinder-b2aaf92c-5970-476f-84b3-5f26b95e3861-delete_snapshot" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-b2aaf92c-5970-476f-84b3-5f26b95e3861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Acquiring lock "cinder-quobyte-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" by "delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Acquiring lock "cinder-quobyte-b2aaf92c-5970-476f-84b3-5f26b95e3861" by "_delete_snapshot" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-b2aaf92c-5970-476f-84b3-5f26b95e3861" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Deleting offline snapshot b2aaf92c-5970-476f-84b3-5f26b95e3861 of volume d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] snapshot_file for this snap is: volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 {{(pid=83205) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e183f9a-5d0e-41cd-9f8e-b8d7566880e9]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:33 devstack sudo[91835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861
Apr 16 02:46:33 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:33 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-10f6e75a-5214-4e74-a164-6b0a7f919689" returned: 0 in 0.438s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-quobyte-10f6e75a-5214-4e74-a164-6b0a7f919689" released by "delete_volume" :: held 0.973s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Created reservations ['26b43a8d-e2eb-4b14-98e6-71ea52c2b5b3', '7d876b08-b7b8-431d-9050-8209db0b5ee5', '81081108-7160-48d1-b058-27bde86157bb', 'b457ab5e-52e7-4999-99c9-0c0c15832cc1'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:33 devstack sudo[91838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:33 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-23d15e29-5ea7-41c2-b98f-4c5765e18a4f-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Lock "cinder-23d15e29-5ea7-41c2-b98f-4c5765e18a4f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Acquiring lock "cinder-quobyte-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f1c0ee-980a-4418-abfe-4d289385cae3]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:33 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:34 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f
Apr 16 02:46:34 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:34 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861" returned: 0 in 0.528s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.remotefs [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83205) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[188340f5-c065-4286-a856-4b2734072dc2]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:34 devstack sudo[91845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e
Apr 16 02:46:34 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:34 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.472s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:34 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Deleted volume successfully.
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=195,cinder:UPDATE=276,cinder:DELETE=27,cinder:INSERT=61 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-76989f71-9e78-4c98-beb5-9b42e254d713 tempest-CreateVolumesFromSnapshotTest-1034860734 None] Lock "cinder-10f6e75a-5214-4e74-a164-6b0a7f919689-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:34 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" returned: 0 in 0.504s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:34 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f
Apr 16 02:46:34 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:34 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" returned: 0 in 0.517s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:34 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861
Apr 16 02:46:34 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:34 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" returned: 0 in 0.454s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Lock "cinder-quobyte-23d15e29-5ea7-41c2-b98f-4c5765e18a4f" released by "delete_volume" :: held 0.980s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:UPDATE=271,cinder:SELECT=197,cinder:INSERT=68,cinder:DELETE=24 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Created reservations ['8d2b0320-f73d-481e-83d2-a5fc6e149b49', 'e6c30b23-d367-4dc2-a4b7-1d3b3c21145f', 'e780af08-4e93-44b9-ab6c-a6afd6f2cb56', '57301525-86c4-453c-bf17-8ab28524cb88'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:34 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:35 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:35 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:35 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861" returned: 0 in 0.577s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:35 devstack sudo[91867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861
Apr 16 02:46:35 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:35 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.498s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Deleted volume successfully.
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-24017632-9be6-4553-bf40-ff80df04046b tempest-VolumeDependencyTests-456622533 None] Lock "cinder-23d15e29-5ea7-41c2-b98f-4c5765e18a4f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:35 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e.b2aaf92c-5970-476f-84b3-5f26b95e3861" returned: 0 in 0.553s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-b2aaf92c-5970-476f-84b3-5f26b95e3861" released by "_delete_snapshot" :: held 2.229s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" released by "delete_snapshot" :: held 2.241s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Created reservations ['185ea4e3-8279-4a34-847f-b5bfc6899c17', 'd0504cff-d7c3-43c7-884f-2c451a53f777', '87192bfa-c403-4b13-b137-014ff1857ebd', 'd9155870-b3a8-4c73-8de8-c44b0d812842'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:35 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Delete snapshot completed successfully.
Apr 16 02:46:35 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-80375747-3748-4f11-b819-3f0fd8a67b6a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-b2aaf92c-5970-476f-84b3-5f26b95e3861-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Acquiring lock "cinder-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Acquiring lock "cinder-quobyte-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:36 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" acquired by "delete_volume" :: waited 0.011s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:36 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1993dc9f-d038-448c-9d41-6067a055301a]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:36 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:36 devstack sudo[91871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e
Apr 16 02:46:36 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:37 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" returned: 0 in 0.455s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:37 devstack sudo[91876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e
Apr 16 02:46:37 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:37 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" returned: 0 in 0.395s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e" released by "delete_volume" :: held 0.884s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Created reservations ['d951e2e1-5c15-424e-9ec2-0acf7783521b', '2b42cf24-f7a4-473a-8462-90577800e375', '6d6c22e5-aec7-4134-937a-e388123a47d4', '41b3bb51-478b-4925-837e-07417c05c119'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:37 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:37 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Acquiring lock "cinder-64caf7fc-ae06-4cea-8b46-79032213d518-delete_volume" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Lock "cinder-64caf7fc-ae06-4cea-8b46-79032213d518-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Acquiring lock "cinder-quobyte-64caf7fc-ae06-4cea-8b46-79032213d518" by "delete_volume" {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-64caf7fc-ae06-4cea-8b46-79032213d518" acquired by "delete_volume" :: waited 0.007s {{(pid=83205) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d980e87-5bb0-4e49-8412-092a534d701c]: (4, 'qcow2') {{(pid=84115) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 16 02:46:37 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:37 devstack sudo[91881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518
Apr 16 02:46:37 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:38 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.439s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:38 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Deleted volume successfully.
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-33a66eb8-5d66-4876-a5d4-3a43ca18de9a tempest-CinderUnicodeTest-585572987 None] Lock "cinder-d23df57e-edfc-4e8b-8a30-76c7f4c2ea4e-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:38 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518" returned: 0 in 0.488s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:38 devstack sudo[91887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518
Apr 16 02:46:38 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:38 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229/volume-64caf7fc-ae06-4cea-8b46-79032213d518" returned: 0 in 0.408s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Lock "cinder-quobyte-64caf7fc-ae06-4cea-8b46-79032213d518" released by "delete_volume" :: held 0.930s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG cinder.quota [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Created reservations ['a2713481-4ee8-4f24-9308-d9e179778fc5', '4e46ff29-8351-42ba-a50e-561dfbf56748', 'a24056e9-3826-487c-9f08-c6afd53feedd', 'b052e20b-b35c-45e0-8513-4840a877b8f8'] {{(pid=83205) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5': None} {{(pid=83205) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG cinder.volume.drivers.quobyte [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c938db44-a0df-4687-abed-b637e76e64f5'] {{(pid=83205) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.lockutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83205) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 16 02:46:38 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229 {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 16 02:46:38 devstack sudo[91890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229
Apr 16 02:46:38 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 16 02:46:39 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root
Apr 16 02:46:39 devstack cinder-volume[83205]: DEBUG oslo_concurrency.processutils [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cdde768132024dc95b932dbd4d24c229" returned: 0 in 0.471s {{(pid=83205) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 16 02:46:39 devstack cinder-volume[83205]: DEBUG cinder.manager [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Notifying Schedulers of capabilities ... {{(pid=83205) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 16 02:46:39 devstack cinder-volume[83205]: INFO cinder.volume.manager [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Deleted volume successfully.
Apr 16 02:46:39 devstack cinder-volume[83205]: DEBUG cinder.coordination [None req-37a09518-3028-4708-a79b-5115e52ae141 tempest-CinderUnicodeTest-585572987 None] Lock "cinder-64caf7fc-ae06-4cea-8b46-79032213d518-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83205) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 16 02:46:48 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:INSERT=6,cinder:UPDATE=31,cinder:SELECT=20,cinder:DELETE=1 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 16 02:46:49 devstack cinder-volume[83205]: DEBUG dbcounter [-] [83205] Writing DB stats cinder:SELECT=18,cinder:INSERT=10,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=83205) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}